-- Logs begin at Sat 2022-05-28 16:34:50 UTC, end at Sat 2022-05-28 17:50:56 UTC. -- May 28 17:16:28.269043 dv-cinder-843729-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 28 17:16:28.277835 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 28 17:16:28.280375 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat May 28 17:16:28 2022] *** May 28 17:16:28.280375 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 28 17:16:28.280375 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 28 17:16:28.280375 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: nodename: dv-cinder-843729-1-iscsi May 28 17:16:28.280375 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: machine: x86_64 May 28 17:16:28.280375 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: clock source: unix May 28 17:16:28.280375 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: pcre jit disabled May 28 17:16:28.280375 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: detected number of CPU cores: 4 May 28 17:16:28.280375 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: current working directory: / May 28 17:16:28.280375 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: detected binary path: /usr/bin/uwsgi-core May 28 17:16:28.281144 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: your processes number limit is 47680 May 28 17:16:28.281144 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: your memory page size is 4096 bytes May 28 17:16:28.281144 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: detected max file descriptor number: 2048 May 28 17:16:28.281144 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: lock engine: pthread robust mutexes May 28 17:16:28.281144 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: thunder lock: enabled May 28 17:16:28.281144 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 28 17:16:28.281144 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 28 17:16:28.326596 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: Python main interpreter initialized at 0x55a4c223c9c0 May 28 17:16:28.326596 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: python threads support enabled May 28 17:16:28.326596 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: your server socket listen backlog is limited to 100 connections May 28 17:16:28.326596 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: your mercy for graceful operations on workers is 90 seconds May 28 17:16:28.326922 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: mapped 403077 bytes (393 KB) for 2 cores May 28 17:16:28.326998 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: *** Operational MODE: preforking *** May 28 17:16:28.327260 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: *** uWSGI is running in multiple interpreter mode *** May 28 17:16:28.327260 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: spawned uWSGI master process (pid: 103170) May 28 17:16:28.327471 dv-cinder-843729-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 28 17:16:28.327997 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: spawned uWSGI worker 1 (pid: 103171, cores: 1) May 28 17:16:28.328339 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: spawned uWSGI worker 2 (pid: 103172, cores: 1) May 28 17:16:28.328493 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 28 17:16:29.503753 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 28 17:16:29.505320 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 28 17:16:30.230634 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 17:16:30.230634 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: from cryptography.utils import int_from_bytes May 28 17:16:30.231470 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 17:16:30.231470 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: from cryptography.utils import int_from_bytes May 28 17:16:30.237348 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 17:16:30.237348 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: from cryptography.utils import int_from_bytes May 28 17:16:30.237692 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 17:16:30.237692 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: from cryptography.utils import int_from_bytes May 28 17:16:32.816661 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 28 17:16:32.817224 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 28 17:16:32.817425 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 28 17:16:32.817785 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 28 17:16:32.818036 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 28 17:16:32.818418 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.818939 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.819264 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.819605 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.819930 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.820240 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.820559 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.820923 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.821270 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.821662 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.822019 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.822344 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843729-1-iscsi {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.822665 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.822969 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.823271 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 28 17:16:32.823687 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.823772 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 28 17:16:32.823926 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.823926 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.824133 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 28 17:16:32.824225 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.824463 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 28 17:16:32.824699 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.824832 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 28 17:16:32.825098 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.825206 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.825632 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.825731 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.825942 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.826254 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.826348 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.826590 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.826857 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.826960 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.827198 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.827525 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.827624 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.827839 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.828112 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.828199 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.828456 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.828591 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.828934 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.829030 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843729-1-iscsi {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.829280 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.829382 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.829552 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.829658 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.829865 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.829961 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.830201 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843729-1-iscsi {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.830379 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.830536 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.830858 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.830950 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.831177 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.831263 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.831518 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.831620 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.831831 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.831917 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.832135 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.832227 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.832460 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.832547 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.832779 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.832969 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.833094 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.833284 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.833411 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.833603 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.833716 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.833919 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.834017 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.834261 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.834360 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.834584 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.834682 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.834897 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.834993 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.835195 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.835292 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.835466 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.835564 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.835779 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.835867 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.836097 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.836193 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.836413 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.836581 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843729-1-iscsi {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.836892 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.836983 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.837150 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.837355 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.837450 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.837684 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.837786 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.838017 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.838103 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.838325 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.838413 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.838631 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.838717 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.838937 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.839029 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.839243 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.839331 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.839591 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.839688 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.839880 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.839968 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.840185 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.840280 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.840489 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.840575 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.840802 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.840898 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.841114 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.841207 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.841431 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.841517 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.841736 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.841830 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.842052 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.842147 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.842386 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.842472 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.842678 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.842776 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.842932 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.843025 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.843247 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.843368 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.843607 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.843704 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.843933 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.844020 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.844246 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.844339 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.844500 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.844608 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.844757 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.844902 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.845079 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.845195 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.845405 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.845509 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.845719 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.845812 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.846032 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.846137 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.846328 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.846424 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.846577 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.846680 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.846875 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.846973 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.847175 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.847263 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.847513 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.847604 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.847820 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.847920 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.848126 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.848213 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.848429 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.848522 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.848726 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.848821 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.849030 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.849118 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.849333 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.849419 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.849636 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.849779 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.849941 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.850029 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.850245 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.850331 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.850545 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.850640 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.850848 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.850935 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.851149 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.851235 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.851470 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.851561 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.851785 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.851873 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.852621 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.852721 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.852937 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.853237 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.853324 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.853539 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.853634 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.853842 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.853938 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.854156 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.854250 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.854461 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.854562 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.854748 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.854856 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.855060 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.855157 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.855372 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.855469 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.855675 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.855764 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.855994 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.856088 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.856297 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.856385 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.856601 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.856696 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.856902 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.856989 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.857197 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.857282 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.857498 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.857587 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.857806 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.857899 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.858107 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.858199 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.858407 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.858501 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.858703 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.858790 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.859000 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.859086 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.859298 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.859408 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.859626 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.859712 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.859924 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.860023 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.860221 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.860309 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.860515 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.860601 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.860827 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.860930 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.861143 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.861230 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.861447 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.861535 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.861749 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.861844 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.862049 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.862135 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.862360 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.862454 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.862691 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.862785 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.863001 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.863088 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.863311 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.863448 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.863655 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.863755 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.863968 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.864055 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.864284 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.864372 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.864591 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.864733 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.864895 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.864989 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.865204 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.865301 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.865523 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.865626 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.865831 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.865917 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.866390 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.866478 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.866695 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.866782 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.866998 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.867084 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.867304 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.867423 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.867637 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.867725 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.868525 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.868631 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.868869 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.868969 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.869187 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.869276 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.869496 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.869583 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.869812 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.869912 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.870130 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.870215 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.870443 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.870533 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.870750 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.870845 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.871071 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:16:32.871166 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.871440 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.871529 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.871754 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.871854 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.872076 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.872173 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.872395 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.872484 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.872704 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.872801 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.873020 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.873110 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.873320 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.873407 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.873636 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.873733 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.873961 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.874056 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.874271 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.874410 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.874586 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.874675 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.874894 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.874993 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.875214 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.875383 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.875539 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.875652 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.875856 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.875962 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.876165 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.876258 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.876495 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.876587 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.876806 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.876898 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.877119 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.877219 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.877429 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.877522 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.877743 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.877835 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.878052 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.878154 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.878362 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.878463 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.878668 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.878804 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.878970 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.879193 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.879281 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.879585 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.879674 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.879892 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.879979 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.880191 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.880289 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.880508 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.880597 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.880834 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.880931 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.881138 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.881251 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.881467 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.881590 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.881772 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.881918 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.882080 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.882256 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.882388 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.882576 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.882696 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.882901 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.882990 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.883219 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.883318 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.883634 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.883723 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.883945 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.884040 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.884267 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.884363 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.884576 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.884672 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.884880 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.884976 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.885202 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.885291 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.885508 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.885595 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.885818 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.885908 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.886129 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.886216 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.886437 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.886539 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.886745 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.886833 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.887052 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.887146 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.887385 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.887492 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.887711 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.887799 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.888023 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.888110 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.888334 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.888430 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.888641 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.888728 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.888968 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.889100 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.889268 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.889376 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.889589 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.889720 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.889910 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.890005 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.890219 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.890306 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.890519 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.890619 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.890826 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.890914 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.891130 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.891225 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.891451 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.891543 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.891758 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.891844 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.892066 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.892162 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.892365 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.892460 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.892668 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.892757 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.892971 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.893066 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.893274 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.893361 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.893578 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.893674 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.893893 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.893986 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.894198 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.894284 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.894500 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.894596 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.894803 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.894891 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.895104 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.895190 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.895443 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.895588 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.895763 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.895852 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.896099 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.896185 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.896430 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.896527 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.896749 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.896837 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.897067 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.897155 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.897377 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.897465 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.897689 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.897776 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.897996 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.898091 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.898305 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.898401 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.898613 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.898700 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.898922 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.899041 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.899310 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.899416 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.899694 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.899825 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.900014 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.900102 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.900322 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.900422 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.900639 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.900726 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.900947 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.901041 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.901254 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.901348 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.901555 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.901640 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.901863 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.901958 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.902175 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.902264 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.902506 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.902594 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.902817 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.902912 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.903125 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.903212 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.903453 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.903543 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.903762 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.903871 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.904067 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.904154 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.904377 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.904464 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.904686 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.904783 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.904996 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.905083 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.905313 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.905453 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.905628 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.905725 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.905942 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.906031 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.906249 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.906337 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.906567 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.906656 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.906874 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.906961 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.907190 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.907276 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.907516 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.907607 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.907827 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.907921 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.908167 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.908259 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.908471 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.908559 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.908773 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.908858 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.909082 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.909177 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.909400 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.909486 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.909705 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.909790 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.910013 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.910108 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.910320 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.910407 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.910622 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.910710 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.910923 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.911019 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.911229 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.911316 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.911565 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.911665 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.911873 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.911970 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.912178 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.912273 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.912480 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.912575 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.912789 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.912877 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.913093 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.913180 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.913395 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.913488 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.913695 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.913784 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.914002 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.914096 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.914319 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.914407 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.915225 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.915486 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.915744 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.915833 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.916065 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.916151 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.916392 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.916480 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.916706 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.916794 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.917027 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.917112 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.917335 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.917430 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.917639 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.917726 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.917942 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.918046 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.918246 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.918337 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.918586 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.918679 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.918895 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.918990 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.919199 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.919285 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.919537 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.919635 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.919848 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.919942 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.920153 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.920239 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.920466 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.920625 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.920772 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.920872 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.921078 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.921173 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.921390 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.921475 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.921700 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.921787 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.922008 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.922094 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.922317 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.922405 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.922622 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.922717 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.922928 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.923021 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.923235 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.923321 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.923579 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.923668 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.923887 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.923981 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.924196 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.924283 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.924506 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.924594 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.924811 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.924897 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.925117 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.925212 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.925430 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.925516 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.925748 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.926001 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.926087 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.926336 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.926425 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.926645 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.926732 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.926962 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.927046 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.927280 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.927388 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.927619 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.927705 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.927943 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.928044 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.928264 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.928350 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.928577 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.928661 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.928908 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.929013 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.929194 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.929290 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.929499 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.929586 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.929801 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.929888 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.930110 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.930198 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.930998 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.931095 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.931303 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.931496 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.931631 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.931824 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.931938 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.932145 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.932232 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.932465 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.932574 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.932796 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.932892 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.933103 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.933189 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.933414 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.933511 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.933719 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.933807 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.934027 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.934111 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.934326 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.934413 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.934649 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.934744 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.934956 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.935219 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.935414 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.935571 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.935658 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.935875 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.936017 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.936203 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.936299 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.936510 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.936597 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.936839 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.936926 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.937159 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.937254 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.937495 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.937581 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.937797 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.937883 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.938100 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.938196 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.938421 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.938509 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.938725 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.938813 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.939026 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.939113 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.939327 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.939434 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.939657 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.939744 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.939962 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.940064 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.940264 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.940358 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.940572 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.940659 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.940878 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.940973 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.941181 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.941267 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.941487 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.941572 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.941784 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.941878 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.942089 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.942176 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.942391 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.942478 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.942703 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.942797 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.943005 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.943091 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.943305 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.943446 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.943627 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.943724 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.943933 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.944020 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.944236 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.944322 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.944537 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.944624 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.944842 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.944928 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.945143 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.945232 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.945454 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.945550 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.945754 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.945848 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.946621 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.946710 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.946926 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.947074 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.947233 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.947320 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.947562 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.947666 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.947863 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.947950 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.948182 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.948273 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.948491 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.948591 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.948793 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.948881 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.949095 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.949182 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.949400 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.949499 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.949698 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.949792 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.949999 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.950085 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.950304 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.950404 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.950618 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.950704 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.950929 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.951014 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.951227 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.951314 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.951559 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.951659 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.951862 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.951957 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.952165 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.952253 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.952467 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.952554 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.952771 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.952856 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.953068 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.953162 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.953369 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.953463 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.953669 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.953765 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.953970 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.954057 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.954271 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.954358 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.954590 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.954690 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.954895 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.954981 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.955196 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.955293 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.955524 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.955625 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.955829 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.955962 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.956139 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.956233 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.956448 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.956549 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.956776 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.956870 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.957092 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.957180 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.957400 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.957494 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.957708 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.957795 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.958018 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.958103 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.958323 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.958409 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.958630 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.958723 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.958932 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.959019 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.959245 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.959332 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.959575 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.959663 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.959883 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.959968 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.960183 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.960269 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.960484 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.960572 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.960791 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.960884 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.961096 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.961183 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.961402 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.961547 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.962322 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.962491 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.962634 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.962723 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.962945 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.963041 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.963258 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.963374 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.963597 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.963685 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.963928 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.964017 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.964244 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.964341 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.964550 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.964636 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.964857 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.964960 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.965164 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.965260 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.965474 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.965561 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.965783 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.965869 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.966093 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.966181 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.966401 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.966488 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.966709 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.966804 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.967016 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.967116 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.967321 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.967448 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.967646 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.967734 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.967968 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.968064 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.968275 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.968362 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.968577 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.968664 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.968882 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.968971 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.969186 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.969281 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.969491 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.969630 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.969791 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.969878 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.970114 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.970207 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.970431 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.970573 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.970746 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.970833 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.971070 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.971165 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.971407 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.971510 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.971717 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.971805 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.972027 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.972119 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.972333 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.972429 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.972635 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.972722 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.972943 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.973029 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.973256 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.973345 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.973569 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.973657 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.973882 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.973969 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.974197 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.974285 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.974500 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.974587 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.974808 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.974902 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.975119 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.975205 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.975447 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.975536 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.975750 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.975838 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.976051 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.976184 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.976357 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.976442 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.976664 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.976758 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.976980 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.977067 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.977314 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.977519 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.977662 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.977837 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.977928 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.978143 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.978239 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.978510 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.978596 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.978852 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.978940 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.979160 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.979248 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.979506 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.979601 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.979829 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.979925 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.980151 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.980246 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.980455 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.980551 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.980766 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.980854 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.981073 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.981161 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.981378 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.981472 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.981702 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.981788 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.982011 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.982106 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.982322 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.982417 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.982624 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.982718 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.982944 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.983041 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.983265 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.983412 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.983599 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.983688 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.983919 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.984013 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.984225 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.984332 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.984540 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.984654 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.984831 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.984964 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.985161 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.985282 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.985470 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.985603 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.985796 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.985906 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.986207 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.986292 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.986520 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.986614 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.986821 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.986955 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.987126 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.987237 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.987468 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.987563 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.987772 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.987881 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.988081 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.988210 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.988392 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.988535 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.988698 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.988864 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.989001 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.989174 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.989302 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.989492 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.989623 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.989805 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.989923 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.990141 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.990239 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.990461 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.990548 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.990777 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.990864 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.991384 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.991514 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.991692 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.991791 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.992022 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.992110 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.992341 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.992430 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.992646 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.992751 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.993004 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.993199 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.993418 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.993645 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.993733 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.994046 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.994132 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.994377 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.994467 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.994697 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.994783 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.995004 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.995155 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.995312 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.995446 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.995649 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.995737 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.995959 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.996046 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.996269 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.996358 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.996592 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.996678 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.996899 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.996994 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.997215 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.997310 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.997519 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.997613 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.997823 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.997919 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.998128 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.998215 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.998431 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.998525 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.998735 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.998833 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.999039 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.999134 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.999363 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.999455 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.999671 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.999772 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:32.999975 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.000065 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.000276 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.000363 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.000595 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.000691 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.000898 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.000986 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.001215 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.001310 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.001521 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.001608 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.001825 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.001911 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.002127 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.002213 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.002429 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.002520 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.002767 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.002855 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.003069 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.003155 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.003439 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.003541 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.003757 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.003861 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.004077 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.004174 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.004401 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.004487 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.004711 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.004806 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.005032 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.005133 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.005348 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.005436 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.005660 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.005748 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.005970 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.006066 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.006281 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.006369 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.006595 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.006687 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.006901 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.006996 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.007210 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.007297 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.007540 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.007631 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.007853 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.007949 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.008159 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.008281 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.009003 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.009155 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.009316 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.009621 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.009714 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.009932 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.010021 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.010258 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.010356 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.010571 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.010659 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.010882 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.010979 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.011193 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.011295 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.011530 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.011620 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.011838 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.011925 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.012150 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.012241 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.012458 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.012545 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.012766 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.012853 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.013090 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.013179 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.013412 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.013508 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.013734 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.013822 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.014059 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.014147 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.014373 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.014459 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.014687 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.014787 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.015002 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.015091 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.015316 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.015461 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.015659 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.015755 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.015980 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.016069 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.016283 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.016369 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.016595 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.016692 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.016911 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.016997 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.017223 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.017315 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.017536 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.017625 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.017847 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.018060 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.018148 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.018678 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.018787 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.018870 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.018950 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.019038 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.019118 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.019322 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.019446 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.019666 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.019755 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.019984 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.020070 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.020299 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.020394 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.020619 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.020708 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.020929 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.021064 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.021239 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.021336 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.021552 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.021640 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.021882 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.022066 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.022212 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.022379 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.022552 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.022710 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.022874 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.023034 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.023196 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.023395 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.023545 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.023691 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.023869 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.024115 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.024310 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.024597 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.024693 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.024904 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.024992 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.025208 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.025297 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.025518 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.025606 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.025826 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.025928 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.026131 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.026218 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.026452 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.026539 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.026760 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.026864 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.027068 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.027156 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.027401 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.027490 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.027710 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.027809 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.028027 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.028239 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.028348 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.028587 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.028683 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.028925 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.029046 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.029224 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.029313 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.029548 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.029648 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.029863 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.029951 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.030167 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.030255 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.030488 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.030737 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.030833 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.031060 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.031196 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.031407 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.031510 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.031719 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.031808 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.032021 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.032109 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.032325 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.032490 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.032635 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.032724 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.032941 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.033029 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.033243 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.033344 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.033549 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.033637 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.033853 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.033941 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.034176 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.034273 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.034476 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.034564 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.034780 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.034868 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.035083 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.035179 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.035423 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.035512 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.035729 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.035816 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.036032 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.036122 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.036335 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.036572 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.036660 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.036924 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.037025 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.037226 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.037312 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.037533 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.037627 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.037835 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.037935 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.038146 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.038233 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.038447 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.038535 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.038753 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.038848 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.039090 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.039177 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.039426 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.039518 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.040276 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.040368 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.040594 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.040681 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.040975 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.041061 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.041289 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.041378 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.041603 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.041691 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.041915 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.042001 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.042222 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.042310 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.042538 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.042626 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.042848 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.042938 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.043180 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.043401 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.043522 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.043735 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.043830 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.044053 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.044150 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.044385 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.044474 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.044713 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.044801 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.045018 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.045107 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.045322 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.045410 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.045627 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.045721 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.045944 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.046032 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.046251 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.046345 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.046560 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.046646 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.046864 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.046952 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.047172 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.047259 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.047504 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.047605 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.047811 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.047897 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.048119 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.048207 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.048426 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.048527 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.048731 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.048818 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.049037 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.049124 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.049343 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.049442 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.049648 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.049735 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.049954 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.050042 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.050265 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.050412 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.050584 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.050671 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.050905 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.050991 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.051220 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.051316 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.051640 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.051801 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.051956 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.052149 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.052250 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.052483 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.052578 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.052827 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.052916 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.053147 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.053243 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.053461 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.053549 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.053773 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.053859 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.054084 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.054178 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.054388 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.054484 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.054721 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.054809 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.055040 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.055129 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.055449 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.055554 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.055773 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.056012 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.056109 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.056329 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.056417 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.056652 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.056740 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.056977 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.057073 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.057291 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.057379 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.057602 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.057688 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.057917 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.058004 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.058228 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.058314 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.058545 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.058632 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.058866 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.058954 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.059194 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.059280 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.059525 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.059630 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.059832 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.059919 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.060136 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.060225 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.060448 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.060545 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.060766 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.060853 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.061075 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.061163 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.061380 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.061524 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.061683 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.061771 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.061990 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.062087 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.062293 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.062453 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.062593 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.062680 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.062894 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.062981 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.063194 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.063330 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.063524 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.063672 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.063826 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.063997 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.064129 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.064326 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.064414 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.064641 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.064729 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.064977 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.065089 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.065290 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.065389 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.065595 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.065683 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.065897 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.065985 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.066199 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.066286 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.066499 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.066596 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.066799 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.066888 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.067100 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.067188 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.067459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.067551 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.067792 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.067881 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.068104 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.068199 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.068418 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.068504 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.068725 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.068812 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.069044 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.069130 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.069347 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.069441 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.069652 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.069738 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.069959 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.070046 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.070272 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.070368 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.070578 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.070664 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.071426 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.071594 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.071741 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.071844 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.072052 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.072154 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.072367 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.072455 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.072674 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.072763 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.072986 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.073075 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.073292 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.073379 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.073599 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.073688 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.073907 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.074002 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.074216 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.074303 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.074528 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.074616 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.074842 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.074929 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.075150 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.075237 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.075481 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.075573 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.075789 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.075879 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.076094 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.076195 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.076409 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.076495 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.076719 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.076806 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.077035 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.077131 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.077344 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.077432 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.077653 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.077741 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.077974 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.078073 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.078284 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.078374 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.078603 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.078696 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.078927 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.079014 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.079232 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.079319 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.079574 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.079662 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.079895 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.079991 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.080211 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.080305 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.080531 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.080656 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.080849 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.080938 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.081164 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.081253 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.081477 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.081571 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.081789 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.081880 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.082093 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.082189 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.082335 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 28 17:16:33.082431 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.082723 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.083051 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.083396 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.083723 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.084042 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.084358 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.084696 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.085014 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.085328 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.085647 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.085962 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.086277 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.087226 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.087585 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.087925 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.088260 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.088580 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.088914 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.089247 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.089600 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.089922 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.090274 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.090610 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.090934 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.091251 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.091586 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:16:33.091835 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 28 17:16:33.142752 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO dbcounter [None req-547a931f-7371-4a76-b3e8-c60f3733f572 None None] Registered counter for database nova_api May 28 17:16:33.152371 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO dbcounter [None req-1c62ef70-bb4e-4374-84c1-b2ef9b3b17d3 None None] Registered counter for database nova_api May 28 17:16:33.163876 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG oslo_db.sqlalchemy.engines [None req-547a931f-7371-4a76-b3e8-c60f3733f572 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103172) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 17:16:33.170798 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writer thread running {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 17:16:33.174639 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG oslo_db.sqlalchemy.engines [None req-1c62ef70-bb4e-4374-84c1-b2ef9b3b17d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 17:16:33.184644 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writer thread running {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 17:16:33.228951 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.context [None req-547a931f-7371-4a76-b3e8-c60f3733f572 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8bcdc320-938f-4056-a651-903bfb22d443(cell1) {{(pid=103172) load_cells /opt/stack/nova/nova/context.py:464}} May 28 17:16:33.232998 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG oslo_concurrency.lockutils [None req-547a931f-7371-4a76-b3e8-c60f3733f572 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:16:33.234554 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG oslo_concurrency.lockutils [None req-547a931f-7371-4a76-b3e8-c60f3733f572 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:16:33.235329 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG oslo_concurrency.lockutils [None req-547a931f-7371-4a76-b3e8-c60f3733f572 None None] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:16:33.237311 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG oslo_concurrency.lockutils [None req-547a931f-7371-4a76-b3e8-c60f3733f572 None None] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:16:33.239265 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO dbcounter [None req-547a931f-7371-4a76-b3e8-c60f3733f572 None None] Registered counter for database nova_cell0 May 28 17:16:33.240855 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.context [None req-1c62ef70-bb4e-4374-84c1-b2ef9b3b17d3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8bcdc320-938f-4056-a651-903bfb22d443(cell1) {{(pid=103171) load_cells /opt/stack/nova/nova/context.py:464}} May 28 17:16:33.244050 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO dbcounter [None req-547a931f-7371-4a76-b3e8-c60f3733f572 None None] Registered counter for database nova_cell1 May 28 17:16:33.245974 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-1c62ef70-bb4e-4374-84c1-b2ef9b3b17d3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:16:33.247687 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-1c62ef70-bb4e-4374-84c1-b2ef9b3b17d3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:16:33.248586 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-1c62ef70-bb4e-4374-84c1-b2ef9b3b17d3 None None] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:16:33.250723 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-1c62ef70-bb4e-4374-84c1-b2ef9b3b17d3 None None] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:16:33.251138 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG oslo_db.sqlalchemy.engines [None req-547a931f-7371-4a76-b3e8-c60f3733f572 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103172) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 17:16:33.252778 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG oslo_db.sqlalchemy.engines [None req-547a931f-7371-4a76-b3e8-c60f3733f572 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103172) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 17:16:33.252890 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO dbcounter [None req-1c62ef70-bb4e-4374-84c1-b2ef9b3b17d3 None None] Registered counter for database nova_cell0 May 28 17:16:33.257107 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO dbcounter [None req-1c62ef70-bb4e-4374-84c1-b2ef9b3b17d3 None None] Registered counter for database nova_cell1 May 28 17:16:33.259425 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writer thread running {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 17:16:33.261098 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writer thread running {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 17:16:33.265032 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG oslo_db.sqlalchemy.engines [None req-1c62ef70-bb4e-4374-84c1-b2ef9b3b17d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 17:16:33.267867 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG oslo_db.sqlalchemy.engines [None req-1c62ef70-bb4e-4374-84c1-b2ef9b3b17d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 17:16:33.271632 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writer thread running {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 17:16:33.405581 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO dbcounter [None req-547a931f-7371-4a76-b3e8-c60f3733f572 None None] Registered counter for database nova_cell0 May 28 17:16:33.411221 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writer thread running {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 17:16:33.414303 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG oslo_db.sqlalchemy.engines [None req-547a931f-7371-4a76-b3e8-c60f3733f572 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103172) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 17:16:33.419294 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writer thread running {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 17:16:33.421971 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO dbcounter [None req-1c62ef70-bb4e-4374-84c1-b2ef9b3b17d3 None None] Registered counter for database nova_cell0 May 28 17:16:33.430916 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG oslo_db.sqlalchemy.engines [None req-1c62ef70-bb4e-4374-84c1-b2ef9b3b17d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 17:16:33.435566 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writer thread running {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 17:16:33.759078 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: WARNING keystonemiddleware.auth_token [None req-547a931f-7371-4a76-b3e8-c60f3733f572 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 17:16:33.760392 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: WARNING keystonemiddleware.auth_token [None req-1c62ef70-bb4e-4374-84c1-b2ef9b3b17d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 17:16:33.766330 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: WARNING keystonemiddleware.auth_token [None req-547a931f-7371-4a76-b3e8-c60f3733f572 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 17:16:33.767651 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: WARNING keystonemiddleware.auth_token [None req-1c62ef70-bb4e-4374-84c1-b2ef9b3b17d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 17:16:34.109162 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: WARNING keystonemiddleware.auth_token [None req-547a931f-7371-4a76-b3e8-c60f3733f572 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 17:16:34.111428 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: WARNING keystonemiddleware.auth_token [None req-1c62ef70-bb4e-4374-84c1-b2ef9b3b17d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 17:16:34.115025 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: WARNING keystonemiddleware.auth_token [None req-547a931f-7371-4a76-b3e8-c60f3733f572 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 17:16:34.117610 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: WARNING keystonemiddleware.auth_token [None req-1c62ef70-bb4e-4374-84c1-b2ef9b3b17d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 17:16:34.121146 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a4c223c9c0 pid: 103172 (default app) May 28 17:16:34.123225 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-547a931f-7371-4a76-b3e8-c60f3733f572 None None] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:16:34.124442 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-547a931f-7371-4a76-b3e8-c60f3733f572 None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001788 May 28 17:16:34.124860 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Sat May 28 17:16:34 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:16:34.125906 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a4c223c9c0 pid: 103171 (default app) May 28 17:17:52.430801 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-547a931f-7371-4a76-b3e8-c60f3733f572 None None] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:17:52.432638 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-547a931f-7371-4a76-b3e8-c60f3733f572 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002271 May 28 17:17:52.435758 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 2/2] 10.222.0.33 () {54 vars in 930 bytes} [Sat May 28 17:17:52 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:17:52.446252 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_api:SELECT=3 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:17:52.447501 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_cell0:SELECT=3 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:17:52.448634 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_cell1:SELECT=3 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:17:52.449779 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_cell0:SELECT=3 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:17:52.898488 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-c4c20b29-75dc-4e50-b917-7658f7e52906 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:17:52.928186 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-c4c20b29-75dc-4e50-b917-7658f7e52906 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.487157 May 28 17:17:52.937404 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 1/3] 10.222.0.33 () {60 vars in 1291 bytes} [Sat May 28 17:17:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:17:55.210735 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-547a931f-7371-4a76-b3e8-c60f3733f572 None None] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:17:55.211790 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-547a931f-7371-4a76-b3e8-c60f3733f572 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001926 May 28 17:17:55.212358 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 3/4] 10.222.0.33 () {54 vars in 930 bytes} [Sat May 28 17:17:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:17:55.277300 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-79d58866-7a1d-4216-9a25-96a2dd632a86 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "cirros256", "swap": 0, "os-flavor-access:is_public": true, "id": "c1", "disk": 1, "rxtx_factor": 1.0}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:17:55.296640 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 17:17:55.296640 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: warnings.warn(msg) May 28 17:17:55.325715 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-79d58866-7a1d-4216-9a25-96a2dd632a86 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.107337 May 28 17:17:55.326279 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 2/5] 10.222.0.33 () {64 vars in 1282 bytes} [Sat May 28 17:17:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 17:17:55.339916 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writing DB stats nova_api:SELECT=3 {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:17:55.341260 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writing DB stats nova_cell0:SELECT=3 {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:17:55.342395 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writing DB stats nova_cell1:SELECT=3 {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:17:55.343399 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:17:55.549990 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-6ab065ec-40a6-4994-aa05-baa771a3db9f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:17:55.552455 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 17:17:55.552455 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: warnings.warn(msg) May 28 17:17:55.613690 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-6ab065ec-40a6-4994-aa05-baa771a3db9f admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.279222 May 28 17:17:55.614481 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 4/6] 10.222.0.33 () {64 vars in 1335 bytes} [Sat May 28 17:17:55 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:17:57.876174 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-79d58866-7a1d-4216-9a25-96a2dd632a86 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:17:57.877291 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-79d58866-7a1d-4216-9a25-96a2dd632a86 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 May 28 17:17:57.877770 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 3/7] 10.222.0.33 () {54 vars in 930 bytes} [Sat May 28 17:17:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:17:58.013515 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-e88d4eea-fb39-494c-b15a-2811c8af63f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 5, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "name": "ds512M", "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:17:58.032771 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 17:17:58.032771 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: warnings.warn(msg) May 28 17:17:58.051711 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-e88d4eea-fb39-494c-b15a-2811c8af63f3 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.167220 May 28 17:17:58.052271 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 5/8] 10.222.0.33 () {64 vars in 1282 bytes} [Sat May 28 17:17:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 17:17:58.064626 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-45f44fae-465c-41ef-8c74-31cadd25d267 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:17:58.066114 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 17:17:58.066114 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: warnings.warn(msg) May 28 17:17:58.098078 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-45f44fae-465c-41ef-8c74-31cadd25d267 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037555 May 28 17:17:58.098790 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 4/9] 10.222.0.33 () {64 vars in 1335 bytes} [Sat May 28 17:17:58 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:18:00.444688 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-e88d4eea-fb39-494c-b15a-2811c8af63f3 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:00.446456 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-e88d4eea-fb39-494c-b15a-2811c8af63f3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002172 May 28 17:18:00.447461 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 6/10] 10.222.0.33 () {54 vars in 930 bytes} [Sat May 28 17:18:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:18:00.516395 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-645a4f1d-c3a1-453f-aebd-f12189411fa1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "disk": 10, "id": "d2", "ram": 1024, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:18:00.536029 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-645a4f1d-c3a1-453f-aebd-f12189411fa1 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082930 May 28 17:18:00.537127 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 5/11] 10.222.0.33 () {64 vars in 1282 bytes} [Sat May 28 17:18:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 17:18:00.550491 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-46b51398-ddc7-409b-8eb0-a5748a53da5c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:18:00.579793 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-46b51398-ddc7-409b-8eb0-a5748a53da5c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033376 May 28 17:18:00.580634 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 7/12] 10.222.0.33 () {64 vars in 1335 bytes} [Sat May 28 17:18:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:18:02.848554 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-645a4f1d-c3a1-453f-aebd-f12189411fa1 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:02.849691 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-645a4f1d-c3a1-453f-aebd-f12189411fa1 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 May 28 17:18:02.850296 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 6/13] 10.222.0.33 () {54 vars in 930 bytes} [Sat May 28 17:18:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:18:02.918670 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-43c3c76d-6132-4313-9d0c-58afa1ca0c0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "disk": 10, "vcpus": 2, "ram": 2048, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d3", "os-flavor-access:is_public": true}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:18:02.937134 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-43c3c76d-6132-4313-9d0c-58afa1ca0c0a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080243 May 28 17:18:02.937702 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 8/14] 10.222.0.33 () {64 vars in 1282 bytes} [Sat May 28 17:18:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 17:18:02.950907 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-a1a480dd-a705-4d99-8cf7-e0d7aa935de5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:18:02.977011 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-a1a480dd-a705-4d99-8cf7-e0d7aa935de5 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030018 May 28 17:18:02.977613 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 7/15] 10.222.0.33 () {64 vars in 1335 bytes} [Sat May 28 17:18:02 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:18:05.251281 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-43c3c76d-6132-4313-9d0c-58afa1ca0c0a admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:05.252309 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-43c3c76d-6132-4313-9d0c-58afa1ca0c0a admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 May 28 17:18:05.252708 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 9/16] 10.222.0.33 () {54 vars in 930 bytes} [Sat May 28 17:18:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:18:05.315369 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-117e29bc-c49f-4572-bd92-f8645d00b5f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "rxtx_factor": 1.0, "swap": 0, "disk": 20, "ram": 4096, "id": "d4", "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:18:05.336488 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-117e29bc-c49f-4572-bd92-f8645d00b5f1 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076573 May 28 17:18:05.344077 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 8/17] 10.222.0.33 () {64 vars in 1282 bytes} [Sat May 28 17:18:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 17:18:05.349597 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-cfc6c20a-a565-49bb-8fb7-6efb48329907 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:18:05.373316 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-cfc6c20a-a565-49bb-8fb7-6efb48329907 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027835 May 28 17:18:05.374218 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 10/18] 10.222.0.33 () {64 vars in 1335 bytes} [Sat May 28 17:18:05 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:18:07.683741 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-117e29bc-c49f-4572-bd92-f8645d00b5f1 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:07.684794 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-117e29bc-c49f-4572-bd92-f8645d00b5f1 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 May 28 17:18:07.685377 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 9/19] 10.222.0.33 () {54 vars in 930 bytes} [Sat May 28 17:18:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:18:07.752317 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-0919a447-b812-4b17-a4ae-ee652f251ad2 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:07.775962 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-0919a447-b812-4b17-a4ae-ee652f251ad2 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.084477 May 28 17:18:07.776514 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 11/20] 10.222.0.33 () {60 vars in 1291 bytes} [Sat May 28 17:18:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:18:10.065436 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-117e29bc-c49f-4572-bd92-f8645d00b5f1 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:10.066767 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-117e29bc-c49f-4572-bd92-f8645d00b5f1 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001950 May 28 17:18:10.067399 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 10/21] 10.222.0.33 () {54 vars in 930 bytes} [Sat May 28 17:18:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:18:10.128277 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-2f854ef4-d225-4fa5-9da9-2465d85f9f1e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "name": "m1.tiny", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:18:10.148412 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-2f854ef4-d225-4fa5-9da9-2465d85f9f1e admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.074893 May 28 17:18:10.148962 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 12/22] 10.222.0.33 () {64 vars in 1282 bytes} [Sat May 28 17:18:10 2022] POST /compute/v2.1/flavors => generated 402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 17:18:10.160873 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-81fd21c6-2707-43fa-9c04-ae0796d6161a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:18:10.186627 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-81fd21c6-2707-43fa-9c04-ae0796d6161a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029185 May 28 17:18:10.187378 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 11/23] 10.222.0.33 () {64 vars in 1332 bytes} [Sat May 28 17:18:10 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:18:12.449861 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-2f854ef4-d225-4fa5-9da9-2465d85f9f1e admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:12.450906 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-2f854ef4-d225-4fa5-9da9-2465d85f9f1e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 May 28 17:18:12.451308 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 13/24] 10.222.0.33 () {54 vars in 930 bytes} [Sat May 28 17:18:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:18:12.516903 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-dcb8c2eb-a242-4db6-a47a-3ff3971981a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "2", "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.small"}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:18:12.535241 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-dcb8c2eb-a242-4db6-a47a-3ff3971981a0 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078118 May 28 17:18:12.535845 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 12/25] 10.222.0.33 () {64 vars in 1282 bytes} [Sat May 28 17:18:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 17:18:12.548234 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-44e088a2-00a2-40f6-ad57-0f00cad6f4f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:18:12.570727 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-44e088a2-00a2-40f6-ad57-0f00cad6f4f3 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026157 May 28 17:18:12.571297 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 14/26] 10.222.0.33 () {64 vars in 1332 bytes} [Sat May 28 17:18:12 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:18:15.247833 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-dcb8c2eb-a242-4db6-a47a-3ff3971981a0 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:15.248854 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-dcb8c2eb-a242-4db6-a47a-3ff3971981a0 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 May 28 17:18:15.249292 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 13/27] 10.222.0.33 () {54 vars in 930 bytes} [Sat May 28 17:18:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:18:15.308218 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-05288839-85c3-42fa-90d6-a54611265464 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "os-flavor-access:is_public": true, "swap": 0, "disk": 40, "rxtx_factor": 1.0, "id": "3", "ram": 4096}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:18:15.327279 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-05288839-85c3-42fa-90d6-a54611265464 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.072162 May 28 17:18:15.327865 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 15/28] 10.222.0.33 () {64 vars in 1282 bytes} [Sat May 28 17:18:15 2022] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 17:18:15.340273 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-ff57b554-eeea-493e-9451-546745a94b15 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:18:15.376447 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-ff57b554-eeea-493e-9451-546745a94b15 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039796 May 28 17:18:15.377422 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 14/29] 10.222.0.33 () {64 vars in 1332 bytes} [Sat May 28 17:18:15 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:18:17.704610 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-05288839-85c3-42fa-90d6-a54611265464 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:17.705603 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-05288839-85c3-42fa-90d6-a54611265464 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 May 28 17:18:17.705986 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 16/30] 10.222.0.33 () {54 vars in 930 bytes} [Sat May 28 17:18:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:18:17.771029 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-166959b6-e780-43aa-94cb-bab4747a7af4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "name": "m1.large", "ram": 8192, "id": "4", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:18:17.789871 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-166959b6-e780-43aa-94cb-bab4747a7af4 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074821 May 28 17:18:17.790433 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 15/31] 10.222.0.33 () {64 vars in 1282 bytes} [Sat May 28 17:18:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 17:18:17.802335 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-c357c47e-e30b-4814-8fed-af874694b980 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:18:17.825416 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-c357c47e-e30b-4814-8fed-af874694b980 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026892 May 28 17:18:17.826058 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 17/32] 10.222.0.33 () {64 vars in 1332 bytes} [Sat May 28 17:18:17 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:18:20.167532 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-166959b6-e780-43aa-94cb-bab4747a7af4 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:20.168549 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-166959b6-e780-43aa-94cb-bab4747a7af4 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 May 28 17:18:20.169471 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 16/33] 10.222.0.33 () {54 vars in 930 bytes} [Sat May 28 17:18:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:18:20.229934 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-76583f1d-f3d4-45a9-9af1-ffb601c27b76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "ram": 16384, "os-flavor-access:is_public": true, "vcpus": 8, "disk": 160, "swap": 0}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:18:20.248815 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-76583f1d-f3d4-45a9-9af1-ffb601c27b76 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.073663 May 28 17:18:20.255593 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 18/34] 10.222.0.33 () {64 vars in 1282 bytes} [Sat May 28 17:18:20 2022] POST /compute/v2.1/flavors => generated 408 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 17:18:20.261584 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-5690e0fd-140c-4394-bea0-9ccc620e1455 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:18:20.285503 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-5690e0fd-140c-4394-bea0-9ccc620e1455 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027506 May 28 17:18:20.299372 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 17/35] 10.222.0.33 () {64 vars in 1332 bytes} [Sat May 28 17:18:20 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:18:44.357521 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-76583f1d-f3d4-45a9-9af1-ffb601c27b76 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:44.358525 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-76583f1d-f3d4-45a9-9af1-ffb601c27b76 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 May 28 17:18:44.358924 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 19/36] 10.222.0.33 () {54 vars in 930 bytes} [Sat May 28 17:18:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:18:44.369595 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:18:44.418036 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-99cf6c7a-76b6-4d66-aed9-c71fadfe25ca admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:44.435387 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-99cf6c7a-76b6-4d66-aed9-c71fadfe25ca admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070561 May 28 17:18:44.435929 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 18/37] 10.222.0.33 () {60 vars in 1291 bytes} [Sat May 28 17:18:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:18:45.431939 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-76583f1d-f3d4-45a9-9af1-ffb601c27b76 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:45.432941 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-76583f1d-f3d4-45a9-9af1-ffb601c27b76 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 28 17:18:45.433335 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 20/38] 10.222.0.33 () {56 vars in 1074 bytes} [Sat May 28 17:18:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:18:45.633495 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-330479cd-cc04-45ff-ba22-030eb731494e admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:45.639053 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.wsgi [None req-330479cd-cc04-45ff-ba22-030eb731494e admin admin] HTTP exception thrown: Flavor 42 could not be found. May 28 17:18:45.642242 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-330479cd-cc04-45ff-ba22-030eb731494e admin admin] Request method failure captured: May 28 17:18:45.642242 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 28 17:18:45.642242 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: Accept: application/json May 28 17:18:45.642242 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: Accept-Encoding: gzip, deflate May 28 17:18:45.642242 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: Connection: keep-alive May 28 17:18:45.642242 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: Content-Length: 0 May 28 17:18:45.642242 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: Host: 10.222.0.33 May 28 17:18:45.642242 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: Openstack-Api-Version: compute 2.90 May 28 17:18:45.642242 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: Openstack-System-Scope: None May 28 17:18:45.642242 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: User-Agent: python-novaclient May 28 17:18:45.642242 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Auth-Token: gAAAAABikll1B7Xv612C3dP81O0ghRtEyfDj8lEYvhRpxi4a2Ne1S7_scBtFOvmCL8VnRMoTLViS-p_pxoxltvfdzHYf9nht28YDxwhggvK-5W-V0bvov54UhmRKMrO5TF-cnT_kFVNP7-JgbCBvBA9xXfW-vG4OAFTUnTmy6-A6XuswG7qJwqU May 28 17:18:45.642242 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Domain-Id: None May 28 17:18:45.642242 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Domain-Name: None May 28 17:18:45.642242 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Identity-Status: Confirmed May 28 17:18:45.642242 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Is-Admin-Project: True May 28 17:18:45.642242 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Openstack-Nova-Api-Version: 2.90 May 28 17:18:45.642242 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Project-Domain-Id: default May 28 17:18:45.642242 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Project-Domain-Name: Default May 28 17:18:45.642242 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Project-Id: 3b7d62044f5549a6b53772308a090b05 May 28 17:18:45.642242 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Project-Name: admin May 28 17:18:45.642242 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Role: admin,reader,member May 28 17:18:45.642242 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Roles: admin,reader,member May 28 17:18:45.644608 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b7d62044f5549a6b53772308a090b05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b7d62044f5549a6b53772308a090b05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3b7d62044f5549a6b53772308a090b05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3b7d62044f5549a6b53772308a090b05", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:18:45.644608 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Tenant: admin May 28 17:18:45.644608 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Tenant-Id: 3b7d62044f5549a6b53772308a090b05 May 28 17:18:45.644608 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Tenant-Name: admin May 28 17:18:45.644608 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-User: admin May 28 17:18:45.644608 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-User-Domain-Id: default May 28 17:18:45.644608 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-User-Domain-Name: Default May 28 17:18:45.644608 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-User-Id: 04bc439d29964fc096fdffcc884a8f66 May 28 17:18:45.644608 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-User-Name: admin May 28 17:18:45.644608 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: method: > May 28 17:18:45.644608 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: exception: Flavor 42 could not be found. May 28 17:18:45.644608 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: action_args: {'id': '42'} May 28 17:18:45.644608 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:18:45.644608 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:18:45.646012 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 28 17:18:45.646012 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 28 17:18:45.646012 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 28 17:18:45.646012 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 28 17:18:45.646012 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 17:18:45.646012 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 17:18:45.646012 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 28 17:18:45.646012 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 28 17:18:45.646012 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 28 17:18:45.646012 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:18:45.646012 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 28 17:18:45.646012 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 28 17:18:45.646012 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 28 17:18:45.646012 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi May 28 17:18:45.646012 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:18:45.646012 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi May 28 17:18:45.646012 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:18:45.646012 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:18:45.646012 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:18:45.647519 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:18:45.647519 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:18:45.647519 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:18:45.647519 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:18:45.647519 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 28 17:18:45.647519 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 17:18:45.647519 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 28 17:18:45.647519 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi May 28 17:18:45.647519 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:18:45.647519 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi May 28 17:18:45.647519 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:18:45.647519 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:18:45.647519 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:18:45.647519 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:18:45.647519 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:18:45.647519 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 28 17:18:45.647519 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi May 28 17:18:45.647519 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-330479cd-cc04-45ff-ba22-030eb731494e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:18:45.648852 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-330479cd-cc04-45ff-ba22-030eb731494e admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061399 May 28 17:18:45.648852 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 19/39] 10.222.0.33 () {60 vars in 1190 bytes} [Sat May 28 17:18:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 28 17:18:45.654076 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-7e68bc20-2d23-4eea-a976-fbad2d85deb5 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:45.657093 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:18:45.677353 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-7e68bc20-2d23-4eea-a976-fbad2d85deb5 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026808 May 28 17:18:45.677884 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 21/40] 10.222.0.33 () {60 vars in 1210 bytes} [Sat May 28 17:18:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:18:45.687324 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-e932f07c-6d5e-435e-a61b-1e47cfd29747 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:45.709732 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-e932f07c-6d5e-435e-a61b-1e47cfd29747 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025846 May 28 17:18:45.710285 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 20/41] 10.222.0.33 () {60 vars in 1210 bytes} [Sat May 28 17:18:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:18:45.720753 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-ba1ecd49-44b2-48e0-b0c6-b7fe1d1b581e admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:45.727474 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.wsgi [None req-ba1ecd49-44b2-48e0-b0c6-b7fe1d1b581e admin admin] HTTP exception thrown: Flavor 42 could not be found. May 28 17:18:45.730703 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-ba1ecd49-44b2-48e0-b0c6-b7fe1d1b581e admin admin] Request method failure captured: May 28 17:18:45.730703 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 28 17:18:45.730703 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: Accept: application/json May 28 17:18:45.730703 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: Accept-Encoding: gzip, deflate May 28 17:18:45.730703 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: Connection: keep-alive May 28 17:18:45.730703 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: Content-Length: 0 May 28 17:18:45.730703 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: Host: 10.222.0.33 May 28 17:18:45.730703 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: Openstack-Api-Version: compute 2.90 May 28 17:18:45.730703 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: Openstack-System-Scope: None May 28 17:18:45.730703 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: User-Agent: python-novaclient May 28 17:18:45.730703 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Auth-Token: gAAAAABikll1B7Xv612C3dP81O0ghRtEyfDj8lEYvhRpxi4a2Ne1S7_scBtFOvmCL8VnRMoTLViS-p_pxoxltvfdzHYf9nht28YDxwhggvK-5W-V0bvov54UhmRKMrO5TF-cnT_kFVNP7-JgbCBvBA9xXfW-vG4OAFTUnTmy6-A6XuswG7qJwqU May 28 17:18:45.730703 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Domain-Id: None May 28 17:18:45.730703 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Domain-Name: None May 28 17:18:45.730703 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Identity-Status: Confirmed May 28 17:18:45.730703 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Is-Admin-Project: True May 28 17:18:45.730703 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Openstack-Nova-Api-Version: 2.90 May 28 17:18:45.730703 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Project-Domain-Id: default May 28 17:18:45.730703 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Project-Domain-Name: Default May 28 17:18:45.730703 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Project-Id: 3b7d62044f5549a6b53772308a090b05 May 28 17:18:45.730703 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Project-Name: admin May 28 17:18:45.730703 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Role: admin,reader,member May 28 17:18:45.730703 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Roles: admin,reader,member May 28 17:18:45.732251 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b7d62044f5549a6b53772308a090b05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b7d62044f5549a6b53772308a090b05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3b7d62044f5549a6b53772308a090b05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3b7d62044f5549a6b53772308a090b05", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:18:45.732251 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Tenant: admin May 28 17:18:45.732251 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Tenant-Id: 3b7d62044f5549a6b53772308a090b05 May 28 17:18:45.732251 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Tenant-Name: admin May 28 17:18:45.732251 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-User: admin May 28 17:18:45.732251 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-User-Domain-Id: default May 28 17:18:45.732251 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-User-Domain-Name: Default May 28 17:18:45.732251 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-User-Id: 04bc439d29964fc096fdffcc884a8f66 May 28 17:18:45.732251 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-User-Name: admin May 28 17:18:45.732251 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: method: > May 28 17:18:45.732251 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: exception: Flavor 42 could not be found. May 28 17:18:45.732251 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: action_args: {'id': '42'} May 28 17:18:45.732251 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:18:45.732251 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:18:45.733275 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 28 17:18:45.733275 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 28 17:18:45.733275 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 28 17:18:45.733275 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 28 17:18:45.733275 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 17:18:45.733275 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 17:18:45.733275 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 28 17:18:45.733275 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 28 17:18:45.733275 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 28 17:18:45.733275 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:18:45.733275 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 28 17:18:45.733275 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 28 17:18:45.733275 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 28 17:18:45.733275 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi May 28 17:18:45.733275 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:18:45.733275 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi May 28 17:18:45.733275 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:18:45.733275 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:18:45.733275 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:18:45.734632 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:18:45.734632 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:18:45.734632 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:18:45.734632 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:18:45.734632 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 28 17:18:45.734632 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 17:18:45.734632 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 28 17:18:45.734632 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi May 28 17:18:45.734632 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:18:45.734632 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi May 28 17:18:45.734632 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:18:45.734632 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:18:45.734632 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:18:45.734632 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:18:45.734632 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:18:45.734632 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 28 17:18:45.734632 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi May 28 17:18:45.734632 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-ba1ecd49-44b2-48e0-b0c6-b7fe1d1b581e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:18:45.735908 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-ba1ecd49-44b2-48e0-b0c6-b7fe1d1b581e admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015998 May 28 17:18:45.735908 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 22/42] 10.222.0.33 () {60 vars in 1190 bytes} [Sat May 28 17:18:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 28 17:18:46.606144 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-e932f07c-6d5e-435e-a61b-1e47cfd29747 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:46.607158 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-e932f07c-6d5e-435e-a61b-1e47cfd29747 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 28 17:18:46.607579 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 21/43] 10.222.0.33 () {56 vars in 1074 bytes} [Sat May 28 17:18:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:18:46.794046 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-1862f40d-18ca-494e-a592-98188279ee53 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:46.799323 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.wsgi [None req-1862f40d-18ca-494e-a592-98188279ee53 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 28 17:18:46.801481 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-1862f40d-18ca-494e-a592-98188279ee53 admin admin] Request method failure captured: May 28 17:18:46.801481 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 28 17:18:46.801481 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: Accept: application/json May 28 17:18:46.801481 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: Accept-Encoding: gzip, deflate May 28 17:18:46.801481 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: Connection: keep-alive May 28 17:18:46.801481 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: Content-Length: 0 May 28 17:18:46.801481 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: Host: 10.222.0.33 May 28 17:18:46.801481 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: Openstack-Api-Version: compute 2.90 May 28 17:18:46.801481 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: Openstack-System-Scope: None May 28 17:18:46.801481 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: User-Agent: python-novaclient May 28 17:18:46.801481 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Auth-Token: gAAAAABikll2cCk6hGY8xOzZSZnlWhBdDDTNFT22vvgGBDWkHm6DcIXgUCOWN9dEaza0uSHZlB9QGQaj7U_vLEBt6kpyvlTsXFFx6S5lNCWCNHnAPH4-VG9Png8nPEDi3Fdqx2YsIG0GHHQyqSBocOjI2a3XyxVY274GEYvto06pMs9_mOvJ0tg May 28 17:18:46.801481 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Domain-Id: None May 28 17:18:46.801481 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Domain-Name: None May 28 17:18:46.801481 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Identity-Status: Confirmed May 28 17:18:46.801481 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Is-Admin-Project: True May 28 17:18:46.801481 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Openstack-Nova-Api-Version: 2.90 May 28 17:18:46.801481 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Project-Domain-Id: default May 28 17:18:46.801481 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Project-Domain-Name: Default May 28 17:18:46.801481 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Project-Id: 3b7d62044f5549a6b53772308a090b05 May 28 17:18:46.801481 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Project-Name: admin May 28 17:18:46.801481 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Role: admin,reader,member May 28 17:18:46.801481 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Roles: admin,reader,member May 28 17:18:46.803066 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b7d62044f5549a6b53772308a090b05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b7d62044f5549a6b53772308a090b05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3b7d62044f5549a6b53772308a090b05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3b7d62044f5549a6b53772308a090b05", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:18:46.803066 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Tenant: admin May 28 17:18:46.803066 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Tenant-Id: 3b7d62044f5549a6b53772308a090b05 May 28 17:18:46.803066 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Tenant-Name: admin May 28 17:18:46.803066 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-User: admin May 28 17:18:46.803066 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-User-Domain-Id: default May 28 17:18:46.803066 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-User-Domain-Name: Default May 28 17:18:46.803066 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-User-Id: 04bc439d29964fc096fdffcc884a8f66 May 28 17:18:46.803066 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-User-Name: admin May 28 17:18:46.803066 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: method: > May 28 17:18:46.803066 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: exception: Flavor 84 could not be found. May 28 17:18:46.803066 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: action_args: {'id': '84'} May 28 17:18:46.803066 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:18:46.803066 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:18:46.804090 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 28 17:18:46.804090 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 28 17:18:46.804090 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 28 17:18:46.804090 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 28 17:18:46.804090 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 17:18:46.804090 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 17:18:46.804090 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 28 17:18:46.804090 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 28 17:18:46.804090 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 28 17:18:46.804090 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:18:46.804090 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 28 17:18:46.804090 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 28 17:18:46.804090 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 28 17:18:46.804090 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi May 28 17:18:46.804090 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:18:46.804090 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi May 28 17:18:46.804090 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:18:46.804090 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:18:46.804090 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:18:46.805459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:18:46.805459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:18:46.805459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:18:46.805459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:18:46.805459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 28 17:18:46.805459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 17:18:46.805459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 28 17:18:46.805459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi May 28 17:18:46.805459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:18:46.805459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi May 28 17:18:46.805459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:18:46.805459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:18:46.805459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:18:46.805459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:18:46.805459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:18:46.805459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 28 17:18:46.805459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi May 28 17:18:46.805459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-1862f40d-18ca-494e-a592-98188279ee53 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:18:46.806729 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-1862f40d-18ca-494e-a592-98188279ee53 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059787 May 28 17:18:46.806729 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 23/44] 10.222.0.33 () {60 vars in 1190 bytes} [Sat May 28 17:18:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 28 17:18:46.812584 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-59225ac0-b9e4-4480-b370-e791ad292451 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:46.827510 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-59225ac0-b9e4-4480-b370-e791ad292451 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018324 May 28 17:18:46.828224 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 22/45] 10.222.0.33 () {60 vars in 1210 bytes} [Sat May 28 17:18:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:18:46.840352 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-da5582b0-9a78-4a2a-a9a4-594be57d936f admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:46.857154 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-da5582b0-9a78-4a2a-a9a4-594be57d936f admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022375 May 28 17:18:46.857696 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 24/46] 10.222.0.33 () {60 vars in 1210 bytes} [Sat May 28 17:18:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:18:46.869278 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-bddb22d6-8c7d-4c63-a827-427372c00f6b admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:46.876707 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.wsgi [None req-bddb22d6-8c7d-4c63-a827-427372c00f6b admin admin] HTTP exception thrown: Flavor 84 could not be found. May 28 17:18:46.879128 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-bddb22d6-8c7d-4c63-a827-427372c00f6b admin admin] Request method failure captured: May 28 17:18:46.879128 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 28 17:18:46.879128 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: Accept: application/json May 28 17:18:46.879128 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: Accept-Encoding: gzip, deflate May 28 17:18:46.879128 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: Connection: keep-alive May 28 17:18:46.879128 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: Content-Length: 0 May 28 17:18:46.879128 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: Host: 10.222.0.33 May 28 17:18:46.879128 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: Openstack-Api-Version: compute 2.90 May 28 17:18:46.879128 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: Openstack-System-Scope: None May 28 17:18:46.879128 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: User-Agent: python-novaclient May 28 17:18:46.879128 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Auth-Token: gAAAAABikll2cCk6hGY8xOzZSZnlWhBdDDTNFT22vvgGBDWkHm6DcIXgUCOWN9dEaza0uSHZlB9QGQaj7U_vLEBt6kpyvlTsXFFx6S5lNCWCNHnAPH4-VG9Png8nPEDi3Fdqx2YsIG0GHHQyqSBocOjI2a3XyxVY274GEYvto06pMs9_mOvJ0tg May 28 17:18:46.879128 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Domain-Id: None May 28 17:18:46.879128 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Domain-Name: None May 28 17:18:46.879128 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Identity-Status: Confirmed May 28 17:18:46.879128 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Is-Admin-Project: True May 28 17:18:46.879128 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Openstack-Nova-Api-Version: 2.90 May 28 17:18:46.879128 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Project-Domain-Id: default May 28 17:18:46.879128 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Project-Domain-Name: Default May 28 17:18:46.879128 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Project-Id: 3b7d62044f5549a6b53772308a090b05 May 28 17:18:46.879128 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Project-Name: admin May 28 17:18:46.879128 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Role: admin,reader,member May 28 17:18:46.879128 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Roles: admin,reader,member May 28 17:18:46.880818 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b7d62044f5549a6b53772308a090b05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b7d62044f5549a6b53772308a090b05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3b7d62044f5549a6b53772308a090b05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3b7d62044f5549a6b53772308a090b05", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:18:46.880818 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Tenant: admin May 28 17:18:46.880818 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Tenant-Id: 3b7d62044f5549a6b53772308a090b05 May 28 17:18:46.880818 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Tenant-Name: admin May 28 17:18:46.880818 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-User: admin May 28 17:18:46.880818 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-User-Domain-Id: default May 28 17:18:46.880818 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-User-Domain-Name: Default May 28 17:18:46.880818 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-User-Id: 04bc439d29964fc096fdffcc884a8f66 May 28 17:18:46.880818 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-User-Name: admin May 28 17:18:46.880818 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: method: > May 28 17:18:46.880818 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: exception: Flavor 84 could not be found. May 28 17:18:46.880818 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: action_args: {'id': '84'} May 28 17:18:46.880818 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:18:46.880818 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:18:46.881744 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 28 17:18:46.881744 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 28 17:18:46.881744 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 28 17:18:46.881744 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 28 17:18:46.881744 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 17:18:46.881744 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 17:18:46.881744 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 28 17:18:46.881744 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 28 17:18:46.881744 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 28 17:18:46.881744 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:18:46.881744 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 28 17:18:46.881744 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 28 17:18:46.881744 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 28 17:18:46.881744 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi May 28 17:18:46.881744 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:18:46.881744 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi May 28 17:18:46.881744 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:18:46.881744 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:18:46.881744 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:18:46.882828 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:18:46.882828 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:18:46.882828 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:18:46.882828 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:18:46.882828 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 28 17:18:46.882828 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 17:18:46.882828 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 28 17:18:46.882828 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi May 28 17:18:46.882828 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:18:46.882828 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi May 28 17:18:46.882828 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:18:46.882828 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:18:46.882828 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:18:46.882828 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:18:46.882828 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:18:46.882828 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 28 17:18:46.882828 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi May 28 17:18:46.882828 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-bddb22d6-8c7d-4c63-a827-427372c00f6b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:18:46.883898 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-bddb22d6-8c7d-4c63-a827-427372c00f6b admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.016958 May 28 17:18:46.883898 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 23/47] 10.222.0.33 () {60 vars in 1190 bytes} [Sat May 28 17:18:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 28 17:18:47.760705 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-da5582b0-9a78-4a2a-a9a4-594be57d936f admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:47.761829 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-da5582b0-9a78-4a2a-a9a4-594be57d936f admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 May 28 17:18:47.762238 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 25/48] 10.222.0.33 () {56 vars in 1074 bytes} [Sat May 28 17:18:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:18:47.954835 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-60bbd355-ca3d-4df8-aeee-d54832de2d93 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:47.962843 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.wsgi [None req-60bbd355-ca3d-4df8-aeee-d54832de2d93 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 28 17:18:47.964384 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-60bbd355-ca3d-4df8-aeee-d54832de2d93 admin admin] Request method failure captured: May 28 17:18:47.964384 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 28 17:18:47.964384 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: Accept: application/json May 28 17:18:47.964384 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: Accept-Encoding: gzip, deflate May 28 17:18:47.964384 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: Connection: keep-alive May 28 17:18:47.964384 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: Content-Length: 0 May 28 17:18:47.964384 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: Host: 10.222.0.33 May 28 17:18:47.964384 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: Openstack-Api-Version: compute 2.90 May 28 17:18:47.964384 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: Openstack-System-Scope: None May 28 17:18:47.964384 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: User-Agent: python-novaclient May 28 17:18:47.964384 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Auth-Token: gAAAAABikll3b5DWFiCJFFp9MsRFLgiqnkw3aKFOVyYHky05uet0IHUEVXFCOeocRnJlhiNGRxSnEUhmurUL7SDD_7RHBejBUhXyuur7OV2RloCcZynhQcoGZ2VLt6NpJg64G6kPhch4D4TsIZZKg_QNNTfV0TL3_A2qaW3W85ukm0o2WyDMU2Q May 28 17:18:47.964384 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Domain-Id: None May 28 17:18:47.964384 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Domain-Name: None May 28 17:18:47.964384 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Identity-Status: Confirmed May 28 17:18:47.964384 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Is-Admin-Project: True May 28 17:18:47.964384 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Openstack-Nova-Api-Version: 2.90 May 28 17:18:47.964384 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Project-Domain-Id: default May 28 17:18:47.964384 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Project-Domain-Name: Default May 28 17:18:47.964384 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Project-Id: 3b7d62044f5549a6b53772308a090b05 May 28 17:18:47.964384 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Project-Name: admin May 28 17:18:47.964384 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Role: admin,reader,member May 28 17:18:47.964384 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Roles: admin,reader,member May 28 17:18:47.965928 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b7d62044f5549a6b53772308a090b05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b7d62044f5549a6b53772308a090b05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3b7d62044f5549a6b53772308a090b05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3b7d62044f5549a6b53772308a090b05", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:18:47.965928 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Tenant: admin May 28 17:18:47.965928 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Tenant-Id: 3b7d62044f5549a6b53772308a090b05 May 28 17:18:47.965928 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-Tenant-Name: admin May 28 17:18:47.965928 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-User: admin May 28 17:18:47.965928 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-User-Domain-Id: default May 28 17:18:47.965928 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-User-Domain-Name: Default May 28 17:18:47.965928 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-User-Id: 04bc439d29964fc096fdffcc884a8f66 May 28 17:18:47.965928 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: X-User-Name: admin May 28 17:18:47.965928 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: method: > May 28 17:18:47.965928 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: exception: Flavor 451 could not be found. May 28 17:18:47.965928 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: action_args: {'id': '451'} May 28 17:18:47.965928 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:18:47.965928 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:18:47.966878 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 28 17:18:47.966878 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 28 17:18:47.966878 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 28 17:18:47.966878 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 28 17:18:47.966878 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 17:18:47.966878 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 17:18:47.966878 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 28 17:18:47.966878 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 28 17:18:47.966878 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 28 17:18:47.966878 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:18:47.966878 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 28 17:18:47.966878 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 28 17:18:47.966878 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 28 17:18:47.966878 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi May 28 17:18:47.966878 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:18:47.966878 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi May 28 17:18:47.966878 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:18:47.966878 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:18:47.966878 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:18:47.967974 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:18:47.967974 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:18:47.967974 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:18:47.967974 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:18:47.967974 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 28 17:18:47.967974 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 17:18:47.967974 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 28 17:18:47.967974 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi May 28 17:18:47.967974 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:18:47.967974 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi May 28 17:18:47.967974 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:18:47.967974 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:18:47.967974 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:18:47.967974 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:18:47.967974 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:18:47.967974 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 28 17:18:47.967974 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi May 28 17:18:47.967974 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-60bbd355-ca3d-4df8-aeee-d54832de2d93 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:18:47.969247 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-60bbd355-ca3d-4df8-aeee-d54832de2d93 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061207 May 28 17:18:47.969247 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 24/49] 10.222.0.33 () {60 vars in 1193 bytes} [Sat May 28 17:18:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 28 17:18:47.975879 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-ff2029db-e947-402a-b276-2724abf565b4 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:47.993843 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-ff2029db-e947-402a-b276-2724abf565b4 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021519 May 28 17:18:47.994837 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 26/50] 10.222.0.33 () {60 vars in 1210 bytes} [Sat May 28 17:18:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:18:48.007292 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-0a20095c-b7a5-4d10-8fe3-666f68ce4fd3 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:48.021969 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-0a20095c-b7a5-4d10-8fe3-666f68ce4fd3 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019189 May 28 17:18:48.022535 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 25/51] 10.222.0.33 () {60 vars in 1210 bytes} [Sat May 28 17:18:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:18:48.034550 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-7665e146-c1b8-4704-bb17-92c98720fd1a admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:48.040027 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.wsgi [None req-7665e146-c1b8-4704-bb17-92c98720fd1a admin admin] HTTP exception thrown: Flavor 451 could not be found. May 28 17:18:48.041563 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-7665e146-c1b8-4704-bb17-92c98720fd1a admin admin] Request method failure captured: May 28 17:18:48.041563 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 28 17:18:48.041563 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: Accept: application/json May 28 17:18:48.041563 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: Accept-Encoding: gzip, deflate May 28 17:18:48.041563 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: Connection: keep-alive May 28 17:18:48.041563 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: Content-Length: 0 May 28 17:18:48.041563 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: Host: 10.222.0.33 May 28 17:18:48.041563 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: Openstack-Api-Version: compute 2.90 May 28 17:18:48.041563 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: Openstack-System-Scope: None May 28 17:18:48.041563 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: User-Agent: python-novaclient May 28 17:18:48.041563 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Auth-Token: gAAAAABikll3b5DWFiCJFFp9MsRFLgiqnkw3aKFOVyYHky05uet0IHUEVXFCOeocRnJlhiNGRxSnEUhmurUL7SDD_7RHBejBUhXyuur7OV2RloCcZynhQcoGZ2VLt6NpJg64G6kPhch4D4TsIZZKg_QNNTfV0TL3_A2qaW3W85ukm0o2WyDMU2Q May 28 17:18:48.041563 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Domain-Id: None May 28 17:18:48.041563 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Domain-Name: None May 28 17:18:48.041563 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Identity-Status: Confirmed May 28 17:18:48.041563 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Is-Admin-Project: True May 28 17:18:48.041563 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Openstack-Nova-Api-Version: 2.90 May 28 17:18:48.041563 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Project-Domain-Id: default May 28 17:18:48.041563 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Project-Domain-Name: Default May 28 17:18:48.041563 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Project-Id: 3b7d62044f5549a6b53772308a090b05 May 28 17:18:48.041563 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Project-Name: admin May 28 17:18:48.041563 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Role: admin,reader,member May 28 17:18:48.041563 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Roles: admin,reader,member May 28 17:18:48.043142 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b7d62044f5549a6b53772308a090b05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b7d62044f5549a6b53772308a090b05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3b7d62044f5549a6b53772308a090b05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3b7d62044f5549a6b53772308a090b05", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:18:48.043142 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Tenant: admin May 28 17:18:48.043142 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Tenant-Id: 3b7d62044f5549a6b53772308a090b05 May 28 17:18:48.043142 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-Tenant-Name: admin May 28 17:18:48.043142 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-User: admin May 28 17:18:48.043142 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-User-Domain-Id: default May 28 17:18:48.043142 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-User-Domain-Name: Default May 28 17:18:48.043142 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-User-Id: 04bc439d29964fc096fdffcc884a8f66 May 28 17:18:48.043142 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: X-User-Name: admin May 28 17:18:48.043142 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: method: > May 28 17:18:48.043142 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: exception: Flavor 451 could not be found. May 28 17:18:48.043142 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: action_args: {'id': '451'} May 28 17:18:48.043142 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:18:48.043142 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:18:48.044459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 28 17:18:48.044459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 28 17:18:48.044459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 28 17:18:48.044459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 28 17:18:48.044459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 17:18:48.044459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 17:18:48.044459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 28 17:18:48.044459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 28 17:18:48.044459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 28 17:18:48.044459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:18:48.044459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 28 17:18:48.044459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 28 17:18:48.044459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 28 17:18:48.044459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi May 28 17:18:48.044459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:18:48.044459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi May 28 17:18:48.044459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:18:48.044459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:18:48.044459 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:18:48.045773 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:18:48.045773 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:18:48.045773 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:18:48.045773 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:18:48.045773 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 28 17:18:48.045773 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 17:18:48.045773 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 28 17:18:48.045773 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi May 28 17:18:48.045773 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:18:48.045773 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi May 28 17:18:48.045773 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:18:48.045773 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:18:48.045773 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:18:48.045773 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:18:48.045773 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:18:48.045773 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 28 17:18:48.045773 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi May 28 17:18:48.045773 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-7665e146-c1b8-4704-bb17-92c98720fd1a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:18:48.047144 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-7665e146-c1b8-4704-bb17-92c98720fd1a admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.014189 May 28 17:18:48.047144 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 27/52] 10.222.0.33 () {60 vars in 1193 bytes} [Sat May 28 17:18:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 28 17:18:48.974261 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-0a20095c-b7a5-4d10-8fe3-666f68ce4fd3 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:48.975244 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-0a20095c-b7a5-4d10-8fe3-666f68ce4fd3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 May 28 17:18:48.975668 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 26/53] 10.222.0.33 () {56 vars in 1074 bytes} [Sat May 28 17:18:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:18:49.163735 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-36bfaf72-0efa-4f57-a4f4-5183c30006f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:18:49.182914 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-36bfaf72-0efa-4f57-a4f4-5183c30006f1 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.071380 May 28 17:18:49.183479 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 28/54] 10.222.0.33 () {64 vars in 1235 bytes} [Sat May 28 17:18:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 17:18:50.050169 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-0a20095c-b7a5-4d10-8fe3-666f68ce4fd3 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:50.051172 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-0a20095c-b7a5-4d10-8fe3-666f68ce4fd3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 May 28 17:18:50.051604 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 27/55] 10.222.0.33 () {56 vars in 1074 bytes} [Sat May 28 17:18:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:18:50.243656 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-1e7c9a6e-05c8-4af3-8c39-47b12911d489 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:18:50.260835 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-1e7c9a6e-05c8-4af3-8c39-47b12911d489 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.071743 May 28 17:18:50.261307 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 29/56] 10.222.0.33 () {64 vars in 1235 bytes} [Sat May 28 17:18:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 17:18:51.132027 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-0a20095c-b7a5-4d10-8fe3-666f68ce4fd3 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:51.133028 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-0a20095c-b7a5-4d10-8fe3-666f68ce4fd3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 28 17:18:51.133421 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 28/57] 10.222.0.33 () {56 vars in 1074 bytes} [Sat May 28 17:18:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:18:51.320104 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-70027632-d767-4e44-b1a6-fdf6cc34b559 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:18:51.336784 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-70027632-d767-4e44-b1a6-fdf6cc34b559 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067513 May 28 17:18:51.337321 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 30/58] 10.222.0.33 () {64 vars in 1235 bytes} [Sat May 28 17:18:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 17:18:52.202883 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-0a20095c-b7a5-4d10-8fe3-666f68ce4fd3 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:52.203921 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-0a20095c-b7a5-4d10-8fe3-666f68ce4fd3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 May 28 17:18:52.204318 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 29/59] 10.222.0.33 () {56 vars in 1074 bytes} [Sat May 28 17:18:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:18:52.392809 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-48f5ba37-72a6-4188-84ef-360c4b1b93ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:18:52.411032 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-48f5ba37-72a6-4188-84ef-360c4b1b93ed admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070375 May 28 17:18:52.411639 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 31/60] 10.222.0.33 () {64 vars in 1235 bytes} [Sat May 28 17:18:52 2022] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 17:18:53.317154 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-0a20095c-b7a5-4d10-8fe3-666f68ce4fd3 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:53.318163 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-0a20095c-b7a5-4d10-8fe3-666f68ce4fd3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 May 28 17:18:53.318554 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 30/61] 10.222.0.33 () {56 vars in 1074 bytes} [Sat May 28 17:18:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:18:53.509047 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-4186e10f-5ec2-4e0c-9dba-edb6b14b40d2 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:18:53.530139 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-4186e10f-5ec2-4e0c-9dba-edb6b14b40d2 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073097 May 28 17:18:53.530629 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 32/62] 10.222.0.33 () {60 vars in 1202 bytes} [Sat May 28 17:18:53 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:19:55.701239 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-0a20095c-b7a5-4d10-8fe3-666f68ce4fd3 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:19:55.702275 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-0a20095c-b7a5-4d10-8fe3-666f68ce4fd3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 May 28 17:19:55.702675 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 31/63] 10.222.0.33 () {54 vars in 930 bytes} [Sat May 28 17:19:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:19:55.710801 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:19:55.763740 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-1cdda62f-8af0-4e25-a000-6e0b5ed82c07 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:19:55.783691 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-1cdda62f-8af0-4e25-a000-6e0b5ed82c07 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074348 May 28 17:19:55.784215 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 33/64] 10.222.0.33 () {60 vars in 1291 bytes} [Sat May 28 17:19:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:19:55.804778 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_api:SELECT=14 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:19:55.808568 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-f5f346b7-4f65-4afd-a627-c944f205a3c5 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:19:55.816348 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-f5f346b7-4f65-4afd-a627-c944f205a3c5 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012985 May 28 17:19:55.816863 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 32/65] 10.222.0.33 () {60 vars in 1282 bytes} [Sat May 28 17:19:55 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:19:55.828583 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-e668fe47-1456-40ce-9cd2-2d0ff0d4e095 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:19:55.836251 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-e668fe47-1456-40ce-9cd2-2d0ff0d4e095 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011795 May 28 17:19:55.836758 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 34/66] 10.222.0.33 () {60 vars in 1285 bytes} [Sat May 28 17:19:55 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:19:55.848812 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-3835e7f7-9cf2-4660-82b2-7fe04869aebb admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:19:55.856254 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-3835e7f7-9cf2-4660-82b2-7fe04869aebb admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010977 May 28 17:19:55.856768 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 33/67] 10.222.0.33 () {60 vars in 1285 bytes} [Sat May 28 17:19:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:19:55.869212 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-fc0f3369-cab7-45e2-9f20-7b7792371958 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:19:55.876764 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-fc0f3369-cab7-45e2-9f20-7b7792371958 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010998 May 28 17:19:55.877262 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 35/68] 10.222.0.33 () {60 vars in 1282 bytes} [Sat May 28 17:19:55 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:23:25.796839 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-3835e7f7-9cf2-4660-82b2-7fe04869aebb admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:23:25.797836 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-3835e7f7-9cf2-4660-82b2-7fe04869aebb admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 May 28 17:23:25.798227 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 34/69] 10.222.0.33 () {56 vars in 1074 bytes} [Sat May 28 17:23:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:23:25.951850 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writing DB stats nova_api:SELECT=6 {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:23:26.066164 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-e5e72919-e6e0-4341-b586-933ff55cb056 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:23:26.067454 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 17:23:26.067454 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: warnings.warn(msg) May 28 17:23:26.068687 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG oslo_concurrency.lockutils [None req-e5e72919-e6e0-4341-b586-933ff55cb056 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:23:26.069170 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG oslo_concurrency.lockutils [None req-e5e72919-e6e0-4341-b586-933ff55cb056 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:23:26.069976 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG oslo_concurrency.lockutils [None req-e5e72919-e6e0-4341-b586-933ff55cb056 admin admin] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:23:26.070465 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG oslo_concurrency.lockutils [None req-e5e72919-e6e0-4341-b586-933ff55cb056 admin admin] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:23:26.105511 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-e5e72919-e6e0-4341-b586-933ff55cb056 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.155037 May 28 17:23:26.106098 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 36/70] 10.222.0.33 () {60 vars in 1193 bytes} [Sat May 28 17:23:25 2022] GET /compute/v2.1/os-services => generated 791 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 17:23:26.993790 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-3835e7f7-9cf2-4660-82b2-7fe04869aebb admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:23:26.995158 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-3835e7f7-9cf2-4660-82b2-7fe04869aebb admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001793 May 28 17:23:26.995584 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 35/71] 10.222.0.33 () {56 vars in 1074 bytes} [Sat May 28 17:23:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:23:27.187869 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-f924e329-2839-4c29-92ac-9e96813c2b7a admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:23:27.189100 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 17:23:27.189100 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: warnings.warn(msg) May 28 17:23:27.190271 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG oslo_concurrency.lockutils [None req-f924e329-2839-4c29-92ac-9e96813c2b7a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:23:27.190712 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG oslo_concurrency.lockutils [None req-f924e329-2839-4c29-92ac-9e96813c2b7a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:23:27.191527 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG oslo_concurrency.lockutils [None req-f924e329-2839-4c29-92ac-9e96813c2b7a admin admin] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:23:27.191953 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG oslo_concurrency.lockutils [None req-f924e329-2839-4c29-92ac-9e96813c2b7a admin admin] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:23:27.212129 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-f924e329-2839-4c29-92ac-9e96813c2b7a admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074753 May 28 17:23:27.213315 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 37/72] 10.222.0.33 () {60 vars in 1193 bytes} [Sat May 28 17:23:27 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 17:23:38.540775 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-3835e7f7-9cf2-4660-82b2-7fe04869aebb admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:23:38.541781 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-3835e7f7-9cf2-4660-82b2-7fe04869aebb admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 May 28 17:23:38.542772 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 36/73] 10.222.0.33 () {56 vars in 1074 bytes} [Sat May 28 17:23:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:23:38.693953 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writing DB stats nova_cell0:SELECT=4 {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:23:38.694690 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writing DB stats nova_cell1:SELECT=4 {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:23:38.695286 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writing DB stats nova_api:SELECT=8 {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:23:38.744530 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-8294ec0b-f613-4a3c-8a91-8cd5825b6413 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:23:38.745781 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 17:23:38.745781 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: warnings.warn(msg) May 28 17:23:38.746941 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG oslo_concurrency.lockutils [None req-8294ec0b-f613-4a3c-8a91-8cd5825b6413 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:23:38.747443 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG oslo_concurrency.lockutils [None req-8294ec0b-f613-4a3c-8a91-8cd5825b6413 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:23:38.748170 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG oslo_concurrency.lockutils [None req-8294ec0b-f613-4a3c-8a91-8cd5825b6413 admin admin] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:23:38.748589 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG oslo_concurrency.lockutils [None req-8294ec0b-f613-4a3c-8a91-8cd5825b6413 admin admin] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:23:38.772769 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-8294ec0b-f613-4a3c-8a91-8cd5825b6413 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.083179 May 28 17:23:38.773306 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 38/74] 10.222.0.33 () {60 vars in 1193 bytes} [Sat May 28 17:23:38 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:23:39.665412 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-3835e7f7-9cf2-4660-82b2-7fe04869aebb admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:23:39.666396 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-3835e7f7-9cf2-4660-82b2-7fe04869aebb admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 May 28 17:23:39.666790 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 37/75] 10.222.0.33 () {56 vars in 1074 bytes} [Sat May 28 17:23:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:23:39.856265 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-0156bcf8-5b5e-4184-b477-3bdd96be114e admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:23:39.857429 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 17:23:39.857429 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: warnings.warn(msg) May 28 17:23:39.858604 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG oslo_concurrency.lockutils [None req-0156bcf8-5b5e-4184-b477-3bdd96be114e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:23:39.859042 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG oslo_concurrency.lockutils [None req-0156bcf8-5b5e-4184-b477-3bdd96be114e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:23:39.859886 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG oslo_concurrency.lockutils [None req-0156bcf8-5b5e-4184-b477-3bdd96be114e admin admin] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:23:39.860318 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: DEBUG oslo_concurrency.lockutils [None req-0156bcf8-5b5e-4184-b477-3bdd96be114e admin admin] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:23:39.881852 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-0156bcf8-5b5e-4184-b477-3bdd96be114e admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.077152 May 28 17:23:39.882334 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 39/76] 10.222.0.33 () {60 vars in 1193 bytes} [Sat May 28 17:23:39 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:24:36.546479 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: Sat May 28 17:24:36 2022 - graceful shutdown triggered... May 28 17:24:36.547023 dv-cinder-843729-1-iscsi devstack@n-api.service[103171]: Gracefully killing worker 1 (pid: 103171)... May 28 17:24:36.548045 dv-cinder-843729-1-iscsi devstack@n-api.service[103172]: Gracefully killing worker 2 (pid: 103172)... May 28 17:24:36.548996 dv-cinder-843729-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 28 17:24:37.547601 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: worker 1 buried after 1 seconds May 28 17:24:37.547601 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: worker 2 buried after 1 seconds May 28 17:24:37.547601 dv-cinder-843729-1-iscsi devstack@n-api.service[103170]: goodbye to uWSGI. May 28 17:24:37.549203 dv-cinder-843729-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 28 17:24:37.549780 dv-cinder-843729-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 28 17:24:37.552540 dv-cinder-843729-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 28 17:24:37.568450 dv-cinder-843729-1-iscsi devstack@n-api.service[117591]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 28 17:24:37.586804 dv-cinder-843729-1-iscsi devstack@n-api.service[117591]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat May 28 17:24:37 2022] *** May 28 17:24:37.586804 dv-cinder-843729-1-iscsi devstack@n-api.service[117591]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 28 17:24:37.586804 dv-cinder-843729-1-iscsi devstack@n-api.service[117591]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 28 17:24:37.586804 dv-cinder-843729-1-iscsi devstack@n-api.service[117591]: nodename: dv-cinder-843729-1-iscsi May 28 17:24:37.586804 dv-cinder-843729-1-iscsi devstack@n-api.service[117591]: machine: x86_64 May 28 17:24:37.586804 dv-cinder-843729-1-iscsi devstack@n-api.service[117591]: clock source: unix May 28 17:24:37.586804 dv-cinder-843729-1-iscsi devstack@n-api.service[117591]: pcre jit disabled May 28 17:24:37.586804 dv-cinder-843729-1-iscsi devstack@n-api.service[117591]: detected number of CPU cores: 4 May 28 17:24:37.586804 dv-cinder-843729-1-iscsi devstack@n-api.service[117591]: current working directory: / May 28 17:24:37.586804 dv-cinder-843729-1-iscsi devstack@n-api.service[117591]: detected binary path: /usr/bin/uwsgi-core May 28 17:24:37.586804 dv-cinder-843729-1-iscsi devstack@n-api.service[117591]: your processes number limit is 47680 May 28 17:24:37.587906 dv-cinder-843729-1-iscsi devstack@n-api.service[117591]: your memory page size is 4096 bytes May 28 17:24:37.587906 dv-cinder-843729-1-iscsi devstack@n-api.service[117591]: detected max file descriptor number: 2048 May 28 17:24:37.587906 dv-cinder-843729-1-iscsi devstack@n-api.service[117591]: lock engine: pthread robust mutexes May 28 17:24:37.587906 dv-cinder-843729-1-iscsi devstack@n-api.service[117591]: thunder lock: enabled May 28 17:24:37.587906 dv-cinder-843729-1-iscsi devstack@n-api.service[117591]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 28 17:24:37.587906 dv-cinder-843729-1-iscsi devstack@n-api.service[117591]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 28 17:24:37.641866 dv-cinder-843729-1-iscsi devstack@n-api.service[117591]: Python main interpreter initialized at 0x5580146c19c0 May 28 17:24:37.641866 dv-cinder-843729-1-iscsi devstack@n-api.service[117591]: python threads support enabled May 28 17:24:37.641866 dv-cinder-843729-1-iscsi devstack@n-api.service[117591]: your server socket listen backlog is limited to 100 connections May 28 17:24:37.641866 dv-cinder-843729-1-iscsi devstack@n-api.service[117591]: your mercy for graceful operations on workers is 90 seconds May 28 17:24:37.642372 dv-cinder-843729-1-iscsi devstack@n-api.service[117591]: mapped 403077 bytes (393 KB) for 2 cores May 28 17:24:37.642372 dv-cinder-843729-1-iscsi devstack@n-api.service[117591]: *** Operational MODE: preforking *** May 28 17:24:37.642665 dv-cinder-843729-1-iscsi devstack@n-api.service[117591]: *** uWSGI is running in multiple interpreter mode *** May 28 17:24:37.642665 dv-cinder-843729-1-iscsi devstack@n-api.service[117591]: spawned uWSGI master process (pid: 117591) May 28 17:24:37.642883 dv-cinder-843729-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 28 17:24:37.643622 dv-cinder-843729-1-iscsi devstack@n-api.service[117591]: spawned uWSGI worker 1 (pid: 117604, cores: 1) May 28 17:24:37.643873 dv-cinder-843729-1-iscsi devstack@n-api.service[117591]: spawned uWSGI worker 2 (pid: 117605, cores: 1) May 28 17:24:37.644027 dv-cinder-843729-1-iscsi devstack@n-api.service[117591]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 28 17:24:38.837599 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 28 17:24:38.920015 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 28 17:24:39.653292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 17:24:39.653292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: from cryptography.utils import int_from_bytes May 28 17:24:39.653669 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 17:24:39.653669 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: from cryptography.utils import int_from_bytes May 28 17:24:39.731603 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 17:24:39.731603 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: from cryptography.utils import int_from_bytes May 28 17:24:39.731927 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 17:24:39.731927 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: from cryptography.utils import int_from_bytes May 28 17:24:42.120801 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 28 17:24:42.121871 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 28 17:24:42.122242 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 28 17:24:42.122611 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 28 17:24:42.122870 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 28 17:24:42.123262 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.123620 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.123945 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.124268 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.124604 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.124914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.125237 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.125558 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.125888 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.126152 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.126471 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.126802 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843729-1-iscsi {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.127124 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.127452 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.127767 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.128088 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.128396 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.128724 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.129031 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.129536 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.129985 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.130294 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.130606 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.130947 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.131264 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.131592 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.132237 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.132553 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.132879 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.133195 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.133592 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843729-1-iscsi {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.133909 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.134224 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.134539 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.134952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.135265 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.135614 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.135938 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.136309 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.136729 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.137065 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.137387 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.137710 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.138033 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.138335 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.138652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.138963 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.139281 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.139619 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.139923 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.140175 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.140485 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.140812 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.141137 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.141462 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.141714 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.141964 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.142285 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.142607 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.142918 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.143229 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.143566 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.143874 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.144181 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.144489 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.144797 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.145123 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.145424 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.145740 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.146063 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.146371 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.146691 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.147090 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.147368 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.147676 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.148016 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.148335 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.148651 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.148971 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.149295 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.149604 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.149911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.150220 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.150538 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.150865 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.151173 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.151448 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.151755 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.152773 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.153147 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.153463 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.153776 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.154089 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.154395 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.154704 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.155015 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.155326 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.155663 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.155977 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.156289 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.156600 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.156909 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.157221 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.157549 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.157876 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.158189 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.158500 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.158813 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.159128 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.159476 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.159790 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.160102 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.160433 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.160747 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.161057 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.161381 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.161698 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.162008 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.162329 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.162636 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.162949 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.163270 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.163608 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.163920 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.164230 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.164539 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.164848 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.165160 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.165469 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.165825 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.166085 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.166410 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.166739 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.167053 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.167383 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.168519 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.168898 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.169254 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.169591 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.169943 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.170264 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.170602 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.170940 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.171266 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.171611 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.171936 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.172263 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.172580 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.172897 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.173212 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.173537 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.173858 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.174191 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.174514 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.174836 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.175159 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.175500 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.175824 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.176159 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.176492 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.176811 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.177163 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.177513 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.177832 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.178164 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.178494 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.178807 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.179120 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.179462 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.179791 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.180132 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.180447 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.180767 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.181083 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.181398 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.181711 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.182029 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.182341 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.182687 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.183004 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.183414 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.183735 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.184196 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.184523 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.184838 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.185153 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.185461 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.185769 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.186078 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.186391 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.186699 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.187027 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.187375 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.187689 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.188031 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.188342 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.188660 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.188978 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.189293 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.189608 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.189923 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.190236 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.190545 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.190873 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.191187 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.191521 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.191850 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.192161 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.192468 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.192789 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.193103 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.193416 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.193728 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.194042 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.194374 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.194690 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.195007 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.195373 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.195703 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.196016 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.196344 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.196672 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.197010 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.197303 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.197616 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.197925 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.198232 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.198537 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.198922 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.199394 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.199677 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.199984 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.200291 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.200598 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.200927 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.201240 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.201555 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.201863 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.202168 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.202523 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.202830 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.203176 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.203544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.203870 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.204195 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.204512 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.204830 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.205144 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.205458 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.205770 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.206084 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.206696 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.207017 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.207356 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.207683 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.208013 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.208327 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.208650 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.208959 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.209279 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.209633 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.209971 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.210289 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.210614 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.210927 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.211243 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.211580 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.211895 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.212208 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.212515 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.212841 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.213151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.213471 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.213783 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.214109 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.215031 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.215414 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.215728 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.216047 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.216386 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.216724 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.217042 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.217360 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.219028 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.219028 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.219028 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.219028 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.219028 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.222425 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.222425 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.222425 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.222425 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.222425 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.222425 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.222425 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.222425 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.223648 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.223648 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.223648 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.223648 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.223648 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.223648 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.223648 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.224267 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.224267 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.224442 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.224630 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.224936 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.225242 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.225548 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.225896 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.226210 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.226519 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.226840 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.227162 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.227498 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.227818 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.228128 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.228442 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.228764 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.229080 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.229391 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.229705 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.230157 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.230540 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.230798 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.231283 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.231637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.231952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.232266 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.232575 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.232887 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.233209 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.233805 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.234143 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.234462 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.234783 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.235106 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.235451 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.235788 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.236118 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.236462 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.236770 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.237080 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.237386 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.237692 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.238005 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.238312 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.238618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.238924 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.239233 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.239574 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.239881 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.240185 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.240496 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.240814 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.241119 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.241433 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.241738 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.242069 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.242380 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.242688 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.243250 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.243580 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.243927 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.244237 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.244581 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.244909 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.245252 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.245560 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.246458 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.246903 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.247215 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.247548 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.247909 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.248255 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.248479 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.248784 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.249099 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.249409 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.249722 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.250034 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.250338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.250647 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.250956 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.251273 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.251612 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.251920 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.252223 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.252534 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.252844 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.253146 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.253455 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.253761 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.254078 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.254383 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.254686 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.254990 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.255298 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.255632 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.255940 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.256267 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.256580 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.256886 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.257191 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.257499 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.257805 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.258110 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.258422 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.258748 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.259065 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.259390 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.259705 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.260013 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.260321 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.260626 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.260940 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.261242 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.261742 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.262051 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.262359 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.262666 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.262990 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.263301 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.263635 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.263941 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.264245 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.264593 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.264900 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.265262 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.265569 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.265885 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.266206 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.266518 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.266830 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.267145 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.267477 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.267797 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.268110 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.268424 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.268731 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.269036 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.269359 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.269672 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.269984 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.270307 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.270628 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.270951 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.271261 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.271595 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.271909 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.272220 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.272533 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.272844 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.273155 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.273468 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.273781 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.274095 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.274408 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.274717 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.275029 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.275356 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.275666 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.275995 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.276311 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.276620 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.277533 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.277810 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.278125 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.278432 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.278875 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.279188 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.279527 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.279838 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.280153 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.280468 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.280789 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.281107 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.281416 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.281843 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.282159 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.282474 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.282788 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.283094 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.283422 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.283739 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.284066 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.284374 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.284681 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.284986 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.285311 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.285619 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.285941 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.286359 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.286673 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.286980 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.287424 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.287743 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.288057 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.288384 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.288710 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.289039 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.289348 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.289666 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.289979 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.290308 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.290634 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.290950 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.291266 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.291603 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.291929 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.292253 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.292665 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.293490 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.293911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.294239 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.294558 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.294883 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.295210 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.295544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.295852 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.296165 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.296475 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.296784 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.297108 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.297415 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.297729 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.298040 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.298350 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.298656 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.298966 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.299294 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.299622 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.299950 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.300266 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.300590 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.300913 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.301223 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.301551 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.301862 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.302169 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.302472 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.302776 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.303121 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.303451 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.303775 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.304106 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.304436 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.304749 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.305085 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.305415 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.305732 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.306052 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.306377 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.306684 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.306988 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.307591 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.307907 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.308264 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.308574 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.308969 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.309281 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.309587 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.309891 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.310217 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.310524 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.310848 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.311160 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.311491 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.311802 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.312104 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.312450 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.312755 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.313088 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.313410 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.313730 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.314061 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.314372 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.314698 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.315017 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.315355 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.315674 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.315991 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.316307 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.316624 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.316941 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.317252 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.317571 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.317888 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.318205 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.318769 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.319103 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.319445 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.319767 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.320083 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.320399 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.320713 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.321026 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.321338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.321656 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.321968 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.322301 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.322625 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.322951 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.323290 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.323634 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.324066 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.324417 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.324731 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.325091 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.325408 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.325718 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.326034 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.326352 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.326668 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.326983 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.327295 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.327634 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.327949 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.328262 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.328573 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.328887 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.329202 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.329528 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.329864 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.330188 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.330504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.330819 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.331139 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.331693 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.332011 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.332347 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.332676 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.333003 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.333322 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.333642 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.333970 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.334278 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.334586 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.334897 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.335209 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.335546 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.335872 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.336186 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.336493 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.336817 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.337131 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.337669 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.338018 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.338337 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.338667 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.338996 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.339317 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.340217 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.340546 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.340854 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.341163 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.341481 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.341795 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.342109 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.342418 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.342735 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.343049 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.343376 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.343696 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.344007 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.344334 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.344643 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.344952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.345260 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.345573 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.345880 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.346187 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.346492 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.346798 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.347113 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.347448 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.347762 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.348101 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.348418 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.348724 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.349036 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.349394 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.349719 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.350026 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.350338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.350648 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.350960 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.351284 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.351625 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.351941 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.352293 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.352613 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.353151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.353487 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.353811 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.354145 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.354480 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.354791 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.355712 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.356037 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.356369 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.356686 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.356999 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.357312 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.357626 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.357938 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.358250 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.358563 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.358877 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.359189 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.359539 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.359853 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.360166 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.360477 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.360794 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.361136 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.361458 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.361778 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.362103 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.362423 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.362740 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.363052 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.363380 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.363693 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.364010 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.364341 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.364657 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.364965 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.365387 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.365701 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.366020 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.366345 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.366656 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.366981 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.367304 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.367640 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.368227 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.368541 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.368875 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.369216 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.369897 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.370232 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.370546 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.371019 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.371367 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.371670 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.371991 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.372306 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.372611 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.372914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.373227 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.373535 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.373839 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.374146 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.374451 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.374760 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.375063 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.375385 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.375695 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.375999 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.376305 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.376610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.376923 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.377228 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.377530 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.377834 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.378136 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.378439 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.378770 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.379103 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.379438 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.379762 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.380077 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.380400 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.380716 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.381040 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.381363 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.381678 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.381993 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.382327 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.382641 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.382957 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.383270 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.383611 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.383925 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.384238 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.384568 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.384896 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.385205 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.385533 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.385858 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.386179 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.386560 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.387307 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.387307 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.388194 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.388194 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.388194 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.388565 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.388757 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.392338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.392338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.392338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.392338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.392338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.392338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.392338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.392338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.393413 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.393413 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.393413 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.393413 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.393413 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.393413 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.393413 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 28 17:24:42.456048 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO dbcounter [None req-08dcd32c-a42c-44a3-9dd6-9859373b1109 None None] Registered counter for database nova_api May 28 17:24:42.476774 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_db.sqlalchemy.engines [None req-08dcd32c-a42c-44a3-9dd6-9859373b1109 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 17:24:42.484717 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writer thread running {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 17:24:42.494895 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 28 17:24:42.495404 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 28 17:24:42.496663 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 28 17:24:42.497214 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 28 17:24:42.497525 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 28 17:24:42.498073 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.498420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.498899 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.499309 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.499679 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.500001 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.500407 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.500816 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.501233 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.501592 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.501983 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.502410 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843729-1-iscsi {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.502809 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.503226 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.503699 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.504079 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.504520 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.504861 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.505316 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.505953 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.506277 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.506716 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.507074 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.507547 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.507935 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.508344 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.508744 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.509146 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.509605 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.509944 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.510485 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843729-1-iscsi {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.510837 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.511299 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.512262 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.512813 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.513244 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.513697 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.514156 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.514615 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.515104 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.515661 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.516204 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.516523 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.516982 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.517464 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.518111 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.518436 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.518826 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.519213 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.519600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.519968 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.520332 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.520756 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.522125 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.522125 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.522125 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.522426 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.522642 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.523071 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.523630 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.523997 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.524417 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.524734 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.525097 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.525524 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.525953 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.526399 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.526732 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.527292 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.527718 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.528082 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.528526 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.529044 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.529357 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.529850 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.530259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.530725 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.531222 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.531585 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.532055 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.532400 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.532946 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.533364 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.533854 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.534274 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.534669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.535010 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.535421 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.535854 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.536206 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.536651 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.537162 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.537507 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.537924 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.538282 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.538695 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.539057 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.539495 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.539875 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.540355 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.540779 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.541102 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.541577 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.541974 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.542370 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.543478 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.543917 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.544385 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.544941 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.545292 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.545737 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.546196 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.546453 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.context [None req-08dcd32c-a42c-44a3-9dd6-9859373b1109 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8bcdc320-938f-4056-a651-903bfb22d443(cell1) {{(pid=117604) load_cells /opt/stack/nova/nova/context.py:464}} May 28 17:24:42.546585 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.547053 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.547463 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.548266 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.548877 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.549320 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.549774 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.550153 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.550535 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.550695 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-08dcd32c-a42c-44a3-9dd6-9859373b1109 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:24:42.550921 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.555531 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.555531 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.555776 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-08dcd32c-a42c-44a3-9dd6-9859373b1109 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:24:42.555864 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.555864 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.556084 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-08dcd32c-a42c-44a3-9dd6-9859373b1109 None None] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:24:42.556195 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.556195 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.556195 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.556195 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.556195 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.556511 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-08dcd32c-a42c-44a3-9dd6-9859373b1109 None None] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:24:42.556693 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.556997 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO dbcounter [None req-08dcd32c-a42c-44a3-9dd6-9859373b1109 None None] Registered counter for database nova_cell0 May 28 17:24:42.557341 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.557977 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.558608 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.559367 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.560066 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 17:24:42.560820 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.561480 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.562096 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO dbcounter [None req-08dcd32c-a42c-44a3-9dd6-9859373b1109 None None] Registered counter for database nova_cell1 May 28 17:24:42.562431 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.563128 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.563807 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.564344 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.564866 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.565398 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.565911 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.566452 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.567041 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.567742 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.568429 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.569114 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.569718 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.570200 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_db.sqlalchemy.engines [None req-08dcd32c-a42c-44a3-9dd6-9859373b1109 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 17:24:42.570684 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.571392 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.572126 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.572591 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.573143 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.573586 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.574479 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.574960 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.575510 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.576032 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.576408 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.576819 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.577283 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.577725 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.578153 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.578605 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.578977 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.579452 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.579868 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_db.sqlalchemy.engines [None req-08dcd32c-a42c-44a3-9dd6-9859373b1109 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 17:24:42.579979 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.580269 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.580747 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.581144 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.581629 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.582051 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.582488 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.583139 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.583612 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.584000 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.584391 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writer thread running {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 17:24:42.584508 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.584752 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writer thread running {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 17:24:42.584870 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.585345 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.585677 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.586190 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.586623 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.587098 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.587515 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.587962 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.588400 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.588791 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.589211 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.590485 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.590888 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.591287 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.591745 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.592173 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.592600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.593023 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.593411 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.593798 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.594215 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.594645 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.594986 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.595316 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.595649 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.595990 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.596308 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.596624 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.596948 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.597271 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.597599 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.597924 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.598279 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.598620 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.598944 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.599266 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.602184 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.602184 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.602184 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.602184 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.602184 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.602184 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.602184 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.602184 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.602744 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.602744 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.603123 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.603776 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.604278 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.604687 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.605180 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.605619 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.606134 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.606520 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.607112 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.607323 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.607895 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.608223 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.608762 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.609169 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.609523 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.609910 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.610266 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.610742 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.611161 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.611647 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.612019 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.612441 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.612869 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.613250 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.613750 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.614189 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.614591 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.615070 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.615583 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.615989 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.616492 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.616884 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.617348 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.617879 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.618565 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.619001 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.619393 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.619788 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.620229 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.620555 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.620967 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.621292 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.621771 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.622241 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.622647 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.623035 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.623687 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.624581 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.624854 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.625314 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.625740 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.626171 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.626659 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.627009 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.627520 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.628022 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.628448 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.628937 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.629358 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.629686 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.630159 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.630563 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.631002 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.631369 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.631822 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.632151 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.632661 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.633049 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.633484 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.633868 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.634314 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.634727 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.635125 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.635625 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.636065 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.636903 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.637334 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.637817 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.638159 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.638609 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.639089 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.639599 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.640060 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.640420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.640886 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.641212 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.641699 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.642155 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.642567 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.642939 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.643406 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.643837 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.644246 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.644715 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.645203 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.645608 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.646004 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.646442 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.646888 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.647309 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.647715 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.648208 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.648667 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.649107 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.649459 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.649876 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.650653 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.651091 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.651453 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.651912 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.652643 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.653036 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.653545 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.653886 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.654412 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.654835 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.655272 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.655618 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.655933 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.656257 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.656572 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.656885 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.657263 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.657518 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.657835 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.658148 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.658457 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.658768 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.659091 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.659429 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.659751 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.660063 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.660395 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.660714 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.661023 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.661374 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.661695 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.662120 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.662574 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.663017 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.663430 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.663904 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.664236 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.664714 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.665150 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.665593 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.666016 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.666385 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.666833 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.667215 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.668136 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.668689 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.669302 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.669695 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.670078 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.670456 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.670877 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.671311 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.671735 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.672078 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.672461 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.672843 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.673274 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.673649 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.674067 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.674468 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.674811 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.675208 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.675611 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.675998 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.676426 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.676852 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.677173 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.677489 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.679001 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.679001 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.679001 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.679001 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.679748 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.679748 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.680089 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.680412 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.680921 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.681357 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.681673 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.682169 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.682567 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.682884 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.683275 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.683938 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.684377 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.684894 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.685212 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.685650 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.685977 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.686403 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.686768 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.687159 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.687521 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.687885 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.688445 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.688848 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.689319 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.689658 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.690062 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.690488 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.690877 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.691332 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.691706 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.692130 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.692560 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.692912 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.693706 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.693706 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.694027 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.694487 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.694906 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.695317 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.697845 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.697845 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.697845 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.697845 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.697845 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.698712 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.698712 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.699843 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.700027 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.700355 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.700681 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.701098 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.701573 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.701956 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.702375 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.702704 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.703092 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.703542 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.704023 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.704429 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.704837 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.705233 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.705623 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.706091 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.706500 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.707033 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.707438 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.707818 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.708198 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.708675 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.709003 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.713288 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.713288 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.713288 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.713288 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.713288 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.713288 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.713288 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.713288 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.714678 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.714678 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.714678 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.714678 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.714678 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.719782 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.719782 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.719782 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.719782 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.719782 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.719782 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.719782 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.719782 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.723201 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.723201 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.723201 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.723201 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.723201 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.723201 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.723201 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.723201 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.724574 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.724574 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.724574 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.724574 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.724574 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.724574 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.724574 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.724574 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.725844 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.725844 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.725844 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.726299 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.726452 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.729023 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.729023 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.729023 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.729023 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.729023 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.729023 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.729998 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.729998 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.729998 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.731118 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.731317 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.731896 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.732283 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.733082 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.733082 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.734209 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.734209 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.734541 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.734770 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.735166 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.735641 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.736005 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.736483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.736865 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.737198 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.737693 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.738089 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.738429 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.738721 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO dbcounter [None req-08dcd32c-a42c-44a3-9dd6-9859373b1109 None None] Registered counter for database nova_cell0 May 28 17:24:42.738889 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.739180 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.739623 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.740088 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.740453 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.741064 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.741512 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.741688 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.742041 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.742240 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.742603 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.742881 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.743543 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.743942 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.744131 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.744408 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.744718 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.745036 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.745365 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.745790 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.746513 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_db.sqlalchemy.engines [None req-08dcd32c-a42c-44a3-9dd6-9859373b1109 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 17:24:42.746668 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.746917 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.747382 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.747694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.747980 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.748428 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.748693 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.749325 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.751375 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.751375 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.751375 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.751375 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.752057 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.752057 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.752321 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.752769 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.753166 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.753588 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.754020 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.754484 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writer thread running {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 17:24:42.754589 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.754900 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.755296 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.756267 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.756684 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.757550 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.757863 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.758288 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.758779 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.759229 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.759583 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.759910 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.760233 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.760696 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.761040 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.761473 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.762110 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.762542 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.763009 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.763523 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.763959 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.765458 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.765458 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.765458 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.765736 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.766013 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.766375 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.766854 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.767203 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.767830 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.768069 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.768500 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.768903 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.769313 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.769731 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.770221 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.770613 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.771084 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.771545 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.772100 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.772381 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.772805 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.773215 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.773641 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.774418 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.774836 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.775229 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.776157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.776658 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.782669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.782669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.782669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.782669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.782669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.782669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.782669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.782669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.783248 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.783852 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.784517 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.785247 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.785809 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.787027 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.787884 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.788843 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.789527 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.790039 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.790778 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.791570 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.792012 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.793034 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.793436 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.793969 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.794445 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.794864 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.795264 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.796625 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.797080 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.797458 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.797999 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.798430 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.798920 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.799773 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.800160 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.800563 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.801035 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.801502 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.801899 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.802286 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.802770 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.803732 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.803732 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.804178 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.804178 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.804561 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.804784 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.805109 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.805475 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.805813 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.806132 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.806448 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.806778 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.807099 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.807459 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.807789 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.808119 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.809435 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.809435 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.809995 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.810342 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.810735 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.811137 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.811680 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.812167 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.812702 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.813207 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.816034 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.816034 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.816034 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.816034 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.816379 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.816702 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.817193 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.817550 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.819102 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.819441 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.819851 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.820289 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.820746 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.821165 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.821570 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.822018 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.822456 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.822955 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.823483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.825842 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.825842 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.825842 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.825842 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.825842 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.826632 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.827269 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.827835 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.828249 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.829509 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.829509 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.829762 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.830124 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.830534 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.830989 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.831497 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.831995 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.832366 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.832889 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.833349 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.833915 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.834405 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.834835 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.835236 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.835659 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.836121 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.836818 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.837009 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.837419 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.837771 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.838184 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.838508 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.838828 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.839145 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.839514 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.839837 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.840158 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.840478 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.840791 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.841104 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.841415 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.841727 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.842045 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.842364 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.842677 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.842990 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.843300 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.845153 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.845897 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.845897 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.846225 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.846522 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.846863 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.847195 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.847745 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.847937 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.848232 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.848565 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.848897 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.849220 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.849565 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.849917 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.850197 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.850518 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.850845 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.851165 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.851547 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.851898 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.852235 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.852747 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.853054 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.853585 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.854006 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.854414 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.854884 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.855842 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.856275 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.856732 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.857088 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.857597 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.860264 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.860264 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.860264 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.860264 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.860264 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.860264 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.860991 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.860991 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.861463 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.861848 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.862304 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.862805 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.863222 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.863738 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.864206 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 17:24:42.864523 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 28 17:24:42.937959 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO dbcounter [None req-b7a78dc5-e00b-4f52-8d6e-48abda454f5a None None] Registered counter for database nova_api May 28 17:24:42.965812 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_db.sqlalchemy.engines [None req-b7a78dc5-e00b-4f52-8d6e-48abda454f5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117605) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 17:24:42.975870 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writer thread running {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 17:24:43.051534 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.context [None req-b7a78dc5-e00b-4f52-8d6e-48abda454f5a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8bcdc320-938f-4056-a651-903bfb22d443(cell1) {{(pid=117605) load_cells /opt/stack/nova/nova/context.py:464}} May 28 17:24:43.056027 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b7a78dc5-e00b-4f52-8d6e-48abda454f5a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:24:43.057962 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b7a78dc5-e00b-4f52-8d6e-48abda454f5a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:24:43.058939 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b7a78dc5-e00b-4f52-8d6e-48abda454f5a None None] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:24:43.061535 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b7a78dc5-e00b-4f52-8d6e-48abda454f5a None None] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:24:43.064208 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO dbcounter [None req-b7a78dc5-e00b-4f52-8d6e-48abda454f5a None None] Registered counter for database nova_cell0 May 28 17:24:43.069496 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO dbcounter [None req-b7a78dc5-e00b-4f52-8d6e-48abda454f5a None None] Registered counter for database nova_cell1 May 28 17:24:43.080529 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_db.sqlalchemy.engines [None req-b7a78dc5-e00b-4f52-8d6e-48abda454f5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117605) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 17:24:43.081727 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_db.sqlalchemy.engines [None req-b7a78dc5-e00b-4f52-8d6e-48abda454f5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117605) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 17:24:43.087601 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writer thread running {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 17:24:43.087751 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: WARNING keystonemiddleware.auth_token [None req-08dcd32c-a42c-44a3-9dd6-9859373b1109 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 17:24:43.095648 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: WARNING keystonemiddleware.auth_token [None req-08dcd32c-a42c-44a3-9dd6-9859373b1109 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 17:24:43.242552 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writer thread running {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 17:24:43.251796 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO dbcounter [None req-b7a78dc5-e00b-4f52-8d6e-48abda454f5a None None] Registered counter for database nova_cell0 May 28 17:24:43.258644 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_db.sqlalchemy.engines [None req-b7a78dc5-e00b-4f52-8d6e-48abda454f5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117605) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 17:24:43.266339 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writer thread running {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 17:24:43.439624 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: WARNING keystonemiddleware.auth_token [None req-08dcd32c-a42c-44a3-9dd6-9859373b1109 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 17:24:43.445557 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: WARNING keystonemiddleware.auth_token [None req-08dcd32c-a42c-44a3-9dd6-9859373b1109 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 17:24:43.451468 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5580146c19c0 pid: 117604 (default app) May 28 17:24:43.697912 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: WARNING keystonemiddleware.auth_token [None req-b7a78dc5-e00b-4f52-8d6e-48abda454f5a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 17:24:43.706256 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: WARNING keystonemiddleware.auth_token [None req-b7a78dc5-e00b-4f52-8d6e-48abda454f5a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 17:24:43.942945 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: WARNING keystonemiddleware.auth_token [None req-b7a78dc5-e00b-4f52-8d6e-48abda454f5a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 17:24:43.949948 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: WARNING keystonemiddleware.auth_token [None req-b7a78dc5-e00b-4f52-8d6e-48abda454f5a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 17:24:43.955221 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5580146c19c0 pid: 117605 (default app) May 28 17:25:24.961886 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=3 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:25:24.963899 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=3 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:25:24.965109 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=3 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:25:24.966224 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=3 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:25:25.276235 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=3 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:25:25.277670 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=3 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:25:25.278996 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=3 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:25:25.279788 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=3 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:25:26.207934 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-22325fa5-fcb8-4540-a7c7-6de582a51f06 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] Action: 'create', calling method: .version_select at 0x7f9efe1f4c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-381717266"}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:25:26.862119 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-169bb4ac-8e90-4af0-976e-8457b94805fe tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1431546217", "imageRef": "b2aab55c-a793-472a-bc32-81af689ad609", "flavorRef": "452", "networks": [{"uuid": "22932a3d-21b2-48a4-9a27-5956f4bdfe95"}]}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:25:27.836567 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.network.neutron [None req-169bb4ac-8e90-4af0-976e-8457b94805fe tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] validate_networks() for [('22932a3d-21b2-48a4-9a27-5956f4bdfe95', None, None, None, None, None)] {{(pid=117605) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 17:25:28.074057 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-22325fa5-fcb8-4540-a7c7-6de582a51f06 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.116457 May 28 17:25:28.081720 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 1/1] 10.222.0.33 () {60 vars in 1154 bytes} [Sat May 28 17:25:24 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3120 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 28 17:25:28.525000 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c410d1cb-68a4-4798-8230-fa6f15666290 tempest-VolumesNegativeTest-1954472210 tempest-VolumesNegativeTest-1954472210-project] Action: 'create', calling method: .version_select at 0x7f9efe041af0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-215897261", "metadata": {"Type": "work"}}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:25:28.545987 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c410d1cb-68a4-4798-8230-fa6f15666290 tempest-VolumesNegativeTest-1954472210 tempest-VolumesNegativeTest-1954472210-project] Request method failure captured: May 28 17:25:28.545987 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 28 17:25:28.545987 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:25:28.545987 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:25:28.545987 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:25:28.545987 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 121 May 28 17:25:28.545987 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:25:28.545987 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:25:28.545987 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:25:28.545987 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:25:28.545987 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABiklsF5c-gqc6xOpEaCeekHkiVMAeEtAp4RFwdBCjcK42f_OLjF1QrZv4k0_j1YQydU0HKCXcp9hORlQJ-74qZh3YSWvtz0rHg3oBuNqcO9rHbYqtccipZcx9eKH56bqSBalaufgRr2q_ZMqWtx2ryZX4eNXh6SEQGq1FU-oVBNvM8NMU May 28 17:25:28.545987 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:25:28.545987 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:25:28.545987 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:25:28.545987 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:25:28.545987 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:25:28.545987 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:25:28.545987 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: 24240be31473431cb8690f8cb08a3cd5 May 28 17:25:28.545987 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-VolumesNegativeTest-1954472210 May 28 17:25:28.545987 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:25:28.545987 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:25:28.547796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/24240be31473431cb8690f8cb08a3cd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/24240be31473431cb8690f8cb08a3cd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/24240be31473431cb8690f8cb08a3cd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_24240be31473431cb8690f8cb08a3cd5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:25:28.547796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-VolumesNegativeTest-1954472210 May 28 17:25:28.547796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 24240be31473431cb8690f8cb08a3cd5 May 28 17:25:28.547796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-VolumesNegativeTest-1954472210 May 28 17:25:28.547796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-VolumesNegativeTest-1954472210-project May 28 17:25:28.547796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:25:28.547796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:25:28.547796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: 3fd43777943042058151ec9ae8479155 May 28 17:25:28.547796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-VolumesNegativeTest-1954472210-project May 28 17:25:28.547796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: May 28 17:25:28.547796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-215897261", "metadata": {"Type": "work"}}} May 28 17:25:28.547796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: May 28 17:25:28.547796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 28 17:25:28.548821 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-215897261', 'metadata': {'Type': 'work'}}}} May 28 17:25:28.548821 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:25:28.548821 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:28.548821 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 17:25:28.548821 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 17:25:28.548821 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 17:25:28.548821 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise error May 28 17:25:28.548821 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 28 17:25:28.548821 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.548821 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 28 17:25:28.548821 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 28 17:25:28.548821 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.548821 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi On instance['volume']: May 28 17:25:28.548821 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi '#$%' May 28 17:25:28.548821 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.548821 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:25:28.548821 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.548821 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:28.548821 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:25:28.548821 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:25:28.548821 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:25:28.548821 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:25:28.551504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 17:25:28.551504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 17:25:28.551504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:25:28.551504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:25:28.551504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 17:25:28.551504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 17:25:28.551504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 17:25:28.551504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 17:25:28.551504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 17:25:28.551504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 17:25:28.551504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 28 17:25:28.551504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.551504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:25:28.551504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.551504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:28.551504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:25:28.551504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:25:28.551504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 17:25:28.551504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 17:25:28.553331 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 28 17:25:28.553331 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.553331 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c410d1cb-68a4-4798-8230-fa6f15666290 tempest-VolumesNegativeTest-1954472210 tempest-VolumesNegativeTest-1954472210-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:25:28.553331 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c410d1cb-68a4-4798-8230-fa6f15666290 tempest-VolumesNegativeTest-1954472210 tempest-VolumesNegativeTest-1954472210-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.471050 May 28 17:25:28.553331 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 2/2] 10.222.0.33 () {60 vars in 1155 bytes} [Sat May 28 17:25:28 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 477 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 17:25:28.559377 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3e9797f1-db57-42ea-bb95-e2f38296ed0d tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] Calling method '.version_select at 0x7f9efe055b80>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:28.657095 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3e9797f1-db57-42ea-bb95-e2f38296ed0d tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f" status: 200 len: 344 microversion: 2.1 time: 0.102756 May 28 17:25:28.657661 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 3/3] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 17:25:28 2022] GET /compute/v2.1/os-volumes/3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f => generated 344 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:25:28.662313 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-014b0a74-22b9-4120-ba5c-ad7207157069 tempest-VolumesNegativeTest-1954472210 tempest-VolumesNegativeTest-1954472210-project] Action: 'create', calling method: .version_select at 0x7f9efe0151f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1888194327", "metadata": {"Type": "work"}}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:25:28.668064 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-014b0a74-22b9-4120-ba5c-ad7207157069 tempest-VolumesNegativeTest-1954472210 tempest-VolumesNegativeTest-1954472210-project] Request method failure captured: May 28 17:25:28.668064 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 28 17:25:28.668064 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:25:28.668064 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:25:28.668064 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:25:28.668064 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 120 May 28 17:25:28.668064 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:25:28.668064 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:25:28.668064 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:25:28.668064 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:25:28.668064 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABiklsF5c-gqc6xOpEaCeekHkiVMAeEtAp4RFwdBCjcK42f_OLjF1QrZv4k0_j1YQydU0HKCXcp9hORlQJ-74qZh3YSWvtz0rHg3oBuNqcO9rHbYqtccipZcx9eKH56bqSBalaufgRr2q_ZMqWtx2ryZX4eNXh6SEQGq1FU-oVBNvM8NMU May 28 17:25:28.668064 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:25:28.668064 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:25:28.668064 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:25:28.668064 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:25:28.668064 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:25:28.668064 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:25:28.668064 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: 24240be31473431cb8690f8cb08a3cd5 May 28 17:25:28.668064 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-VolumesNegativeTest-1954472210 May 28 17:25:28.668064 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:25:28.668064 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:25:28.669465 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/24240be31473431cb8690f8cb08a3cd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/24240be31473431cb8690f8cb08a3cd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/24240be31473431cb8690f8cb08a3cd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_24240be31473431cb8690f8cb08a3cd5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:25:28.669465 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-VolumesNegativeTest-1954472210 May 28 17:25:28.669465 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 24240be31473431cb8690f8cb08a3cd5 May 28 17:25:28.669465 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-VolumesNegativeTest-1954472210 May 28 17:25:28.669465 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-VolumesNegativeTest-1954472210-project May 28 17:25:28.669465 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:25:28.669465 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:25:28.669465 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: 3fd43777943042058151ec9ae8479155 May 28 17:25:28.669465 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-VolumesNegativeTest-1954472210-project May 28 17:25:28.669465 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: May 28 17:25:28.669465 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1888194327", "metadata": {"Type": "work"}}} May 28 17:25:28.669465 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: May 28 17:25:28.669465 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 28 17:25:28.670274 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1888194327', 'metadata': {'Type': 'work'}}}} May 28 17:25:28.670274 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:25:28.670274 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:28.670274 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 17:25:28.670274 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 17:25:28.670274 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 17:25:28.670274 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise error May 28 17:25:28.670274 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 28 17:25:28.670274 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.670274 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 28 17:25:28.670274 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 28 17:25:28.670274 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.670274 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi On instance['volume']: May 28 17:25:28.670274 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi '0' May 28 17:25:28.670274 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.670274 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:25:28.670274 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.670274 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:28.670274 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:25:28.670274 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:25:28.670274 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:25:28.670274 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:25:28.679114 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 17:25:28.679114 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 17:25:28.679114 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:25:28.679114 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:25:28.679114 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 17:25:28.679114 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 17:25:28.679114 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 17:25:28.679114 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 17:25:28.679114 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 17:25:28.679114 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 17:25:28.679114 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 28 17:25:28.679114 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.679114 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:25:28.679114 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.679114 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:28.679114 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:25:28.679114 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:25:28.679114 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 17:25:28.679114 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 17:25:28.681156 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 28 17:25:28.681156 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.681156 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-014b0a74-22b9-4120-ba5c-ad7207157069 tempest-VolumesNegativeTest-1954472210 tempest-VolumesNegativeTest-1954472210-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:25:28.681156 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-014b0a74-22b9-4120-ba5c-ad7207157069 tempest-VolumesNegativeTest-1954472210 tempest-VolumesNegativeTest-1954472210-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010896 May 28 17:25:28.681156 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 4/4] 10.222.0.33 () {60 vars in 1155 bytes} [Sat May 28 17:25:28 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 17:25:28.688459 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-03bc7fe1-08ad-4de9-bc89-d23652b584ab tempest-VolumesNegativeTest-1954472210 tempest-VolumesNegativeTest-1954472210-project] Action: 'create', calling method: .version_select at 0x7f9efe0558b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-254611627", "metadata": {"Type": "work"}}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:25:28.692214 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-03bc7fe1-08ad-4de9-bc89-d23652b584ab tempest-VolumesNegativeTest-1954472210 tempest-VolumesNegativeTest-1954472210-project] Request method failure captured: May 28 17:25:28.692214 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 28 17:25:28.692214 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:25:28.692214 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:25:28.692214 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:25:28.692214 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 118 May 28 17:25:28.692214 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:25:28.692214 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:25:28.692214 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:25:28.692214 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:25:28.692214 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABiklsF5c-gqc6xOpEaCeekHkiVMAeEtAp4RFwdBCjcK42f_OLjF1QrZv4k0_j1YQydU0HKCXcp9hORlQJ-74qZh3YSWvtz0rHg3oBuNqcO9rHbYqtccipZcx9eKH56bqSBalaufgRr2q_ZMqWtx2ryZX4eNXh6SEQGq1FU-oVBNvM8NMU May 28 17:25:28.692214 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:25:28.692214 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:25:28.692214 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:25:28.692214 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:25:28.692214 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:25:28.692214 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:25:28.692214 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: 24240be31473431cb8690f8cb08a3cd5 May 28 17:25:28.692214 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-VolumesNegativeTest-1954472210 May 28 17:25:28.692214 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:25:28.692214 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:25:28.693777 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/24240be31473431cb8690f8cb08a3cd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/24240be31473431cb8690f8cb08a3cd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/24240be31473431cb8690f8cb08a3cd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_24240be31473431cb8690f8cb08a3cd5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:25:28.693777 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-VolumesNegativeTest-1954472210 May 28 17:25:28.693777 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 24240be31473431cb8690f8cb08a3cd5 May 28 17:25:28.693777 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-VolumesNegativeTest-1954472210 May 28 17:25:28.693777 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-VolumesNegativeTest-1954472210-project May 28 17:25:28.693777 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:25:28.693777 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:25:28.693777 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: 3fd43777943042058151ec9ae8479155 May 28 17:25:28.693777 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-VolumesNegativeTest-1954472210-project May 28 17:25:28.693777 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: May 28 17:25:28.693777 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-254611627", "metadata": {"Type": "work"}}} May 28 17:25:28.693777 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: May 28 17:25:28.693777 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 28 17:25:28.694698 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-254611627', 'metadata': {'Type': 'work'}}}} May 28 17:25:28.694698 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:25:28.694698 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:28.694698 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 17:25:28.694698 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 17:25:28.694698 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 17:25:28.694698 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise error May 28 17:25:28.694698 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 28 17:25:28.694698 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.694698 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 28 17:25:28.694698 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 28 17:25:28.694698 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.694698 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi On instance['volume']: May 28 17:25:28.694698 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi '' May 28 17:25:28.694698 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.694698 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:25:28.694698 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.694698 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:28.694698 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:25:28.694698 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:25:28.694698 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:25:28.694698 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:25:28.696332 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 17:25:28.696332 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 17:25:28.696332 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:25:28.696332 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:25:28.696332 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 17:25:28.696332 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 17:25:28.696332 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 17:25:28.696332 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 17:25:28.696332 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 17:25:28.696332 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 17:25:28.696332 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 28 17:25:28.696332 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.696332 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:25:28.696332 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.696332 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:28.696332 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:25:28.696332 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:25:28.696332 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 17:25:28.696332 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 17:25:28.697454 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 28 17:25:28.697454 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.697454 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-03bc7fe1-08ad-4de9-bc89-d23652b584ab tempest-VolumesNegativeTest-1954472210 tempest-VolumesNegativeTest-1954472210-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:25:28.697454 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-03bc7fe1-08ad-4de9-bc89-d23652b584ab tempest-VolumesNegativeTest-1954472210 tempest-VolumesNegativeTest-1954472210-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017850 May 28 17:25:28.701760 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 5/5] 10.222.0.33 () {60 vars in 1155 bytes} [Sat May 28 17:25:28 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 17:25:28.711803 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-86529d08-842c-4b86-be29-93cbf796d58e tempest-VolumesNegativeTest-1954472210 tempest-VolumesNegativeTest-1954472210-project] Calling method '.version_select at 0x7f9efe015550>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:28.791622 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-86529d08-842c-4b86-be29-93cbf796d58e tempest-VolumesNegativeTest-1954472210 tempest-VolumesNegativeTest-1954472210-project] HTTP exception thrown: Volume tempest-invalid-479318374 could not be found. May 28 17:25:28.796281 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-86529d08-842c-4b86-be29-93cbf796d58e tempest-VolumesNegativeTest-1954472210 tempest-VolumesNegativeTest-1954472210-project] Request method failure captured: May 28 17:25:28.796281 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-479318374 HTTP/1.1 May 28 17:25:28.796281 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:25:28.796281 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:25:28.796281 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:25:28.796281 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 0 May 28 17:25:28.796281 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:25:28.796281 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:25:28.796281 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:25:28.796281 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:25:28.796281 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABiklsF5c-gqc6xOpEaCeekHkiVMAeEtAp4RFwdBCjcK42f_OLjF1QrZv4k0_j1YQydU0HKCXcp9hORlQJ-74qZh3YSWvtz0rHg3oBuNqcO9rHbYqtccipZcx9eKH56bqSBalaufgRr2q_ZMqWtx2ryZX4eNXh6SEQGq1FU-oVBNvM8NMU May 28 17:25:28.796281 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:25:28.796281 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:25:28.796281 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:25:28.796281 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:25:28.796281 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:25:28.796281 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:25:28.796281 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: 24240be31473431cb8690f8cb08a3cd5 May 28 17:25:28.796281 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-VolumesNegativeTest-1954472210 May 28 17:25:28.796281 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:25:28.796281 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:25:28.797618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/24240be31473431cb8690f8cb08a3cd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/24240be31473431cb8690f8cb08a3cd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/24240be31473431cb8690f8cb08a3cd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_24240be31473431cb8690f8cb08a3cd5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:25:28.797618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-VolumesNegativeTest-1954472210 May 28 17:25:28.797618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 24240be31473431cb8690f8cb08a3cd5 May 28 17:25:28.797618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-VolumesNegativeTest-1954472210 May 28 17:25:28.797618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-VolumesNegativeTest-1954472210-project May 28 17:25:28.797618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:25:28.797618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:25:28.797618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: 3fd43777943042058151ec9ae8479155 May 28 17:25:28.797618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-VolumesNegativeTest-1954472210-project May 28 17:25:28.797618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: May 28 17:25:28.797618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Volume tempest-invalid-479318374 could not be found. May 28 17:25:28.797618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'id': 'tempest-invalid-479318374'} May 28 17:25:28.797618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:25:28.798440 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:28.798440 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 17:25:28.798440 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 17:25:28.798440 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 28 17:25:28.798440 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 28 17:25:28.798440 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 28 17:25:28.798440 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 28 17:25:28.798440 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 28 17:25:28.798440 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 28 17:25:28.798440 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 28 17:25:28.798440 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 28 17:25:28.798440 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 17:25:28.798440 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 17:25:28.798440 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 17:25:28.798440 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 17:25:28.798440 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-479318374 could not be found. (HTTP 404) (Request-ID: req-6fcd035b-cc2f-42bd-8031-1f757fe0af44) May 28 17:25:28.798440 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.798440 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:25:28.798440 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.800004 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:28.800004 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 28 17:25:28.800004 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 28 17:25:28.800004 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 28 17:25:28.800004 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 28 17:25:28.800004 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 28 17:25:28.800004 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 28 17:25:28.800004 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 28 17:25:28.800004 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 28 17:25:28.800004 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 17:25:28.800004 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 17:25:28.800004 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 28 17:25:28.800004 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 28 17:25:28.800004 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 28 17:25:28.800004 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 28 17:25:28.800004 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 28 17:25:28.800004 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 28 17:25:28.800004 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 28 17:25:28.800004 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 28 17:25:28.801628 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 17:25:28.801628 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 17:25:28.801628 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 17:25:28.801628 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 17:25:28.801628 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-479318374 could not be found. May 28 17:25:28.801628 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.801628 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:25:28.801628 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.801628 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:28.801628 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:25:28.801628 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:25:28.801628 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:25:28.801628 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:25:28.801628 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 17:25:28.801628 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 17:25:28.801628 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:25:28.801628 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:25:28.801628 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 28 17:25:28.801628 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:25:28.801628 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-479318374 could not be found. May 28 17:25:28.802958 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.802958 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:25:28.802958 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.802958 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:28.802958 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:25:28.802958 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:25:28.802958 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:25:28.802958 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:25:28.802958 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-479318374 could not be found. May 28 17:25:28.802958 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.802958 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-86529d08-842c-4b86-be29-93cbf796d58e tempest-VolumesNegativeTest-1954472210 tempest-VolumesNegativeTest-1954472210-project] Returning 404 to user: Volume tempest-invalid-479318374 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:25:28.802958 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-86529d08-842c-4b86-be29-93cbf796d58e tempest-VolumesNegativeTest-1954472210 tempest-VolumesNegativeTest-1954472210-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-479318374" status: 404 len: 98 microversion: 2.1 time: 0.094745 May 28 17:25:28.805074 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 6/6] 10.222.0.33 () {58 vars in 1214 bytes} [Sat May 28 17:25:28 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-479318374 => generated 98 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 17:25:28.810565 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-4a4802f8-a86f-4c16-9799-d50f5d85736d tempest-VolumesNegativeTest-1954472210 tempest-VolumesNegativeTest-1954472210-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004786 May 28 17:25:28.811081 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 7/7] 10.222.0.33 () {58 vars in 1139 bytes} [Sat May 28 17:25:28 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 28 17:25:28.833637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9354edb0-b877-426f-b40d-61a513ddc36c tempest-VolumesNegativeTest-1954472210 tempest-VolumesNegativeTest-1954472210-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003757 May 28 17:25:28.834291 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 8/8] 10.222.0.33 () {58 vars in 1136 bytes} [Sat May 28 17:25:28 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 28 17:25:28.876812 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5adeb825-4f0f-4c27-b129-2a7951bf5a41 tempest-VolumesNegativeTest-1954472210 tempest-VolumesNegativeTest-1954472210-project] Calling method '.version_select at 0x7f9efdfea700>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:28.959111 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-5adeb825-4f0f-4c27-b129-2a7951bf5a41 tempest-VolumesNegativeTest-1954472210 tempest-VolumesNegativeTest-1954472210-project] HTTP exception thrown: Volume fc63f125-18ed-4ceb-b961-337720af9430 could not be found. May 28 17:25:28.961641 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5adeb825-4f0f-4c27-b129-2a7951bf5a41 tempest-VolumesNegativeTest-1954472210 tempest-VolumesNegativeTest-1954472210-project] Request method failure captured: May 28 17:25:28.961641 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: DELETE /compute/v2.1/os-volumes/fc63f125-18ed-4ceb-b961-337720af9430 HTTP/1.1 May 28 17:25:28.961641 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:25:28.961641 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:25:28.961641 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:25:28.961641 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 0 May 28 17:25:28.961641 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:25:28.961641 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:25:28.961641 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:25:28.961641 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:25:28.961641 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABiklsF5c-gqc6xOpEaCeekHkiVMAeEtAp4RFwdBCjcK42f_OLjF1QrZv4k0_j1YQydU0HKCXcp9hORlQJ-74qZh3YSWvtz0rHg3oBuNqcO9rHbYqtccipZcx9eKH56bqSBalaufgRr2q_ZMqWtx2ryZX4eNXh6SEQGq1FU-oVBNvM8NMU May 28 17:25:28.961641 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:25:28.961641 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:25:28.961641 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:25:28.961641 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:25:28.961641 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:25:28.961641 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:25:28.961641 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: 24240be31473431cb8690f8cb08a3cd5 May 28 17:25:28.961641 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-VolumesNegativeTest-1954472210 May 28 17:25:28.961641 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:25:28.961641 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:25:28.963203 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/24240be31473431cb8690f8cb08a3cd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/24240be31473431cb8690f8cb08a3cd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/24240be31473431cb8690f8cb08a3cd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_24240be31473431cb8690f8cb08a3cd5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:25:28.963203 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-VolumesNegativeTest-1954472210 May 28 17:25:28.963203 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 24240be31473431cb8690f8cb08a3cd5 May 28 17:25:28.963203 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-VolumesNegativeTest-1954472210 May 28 17:25:28.963203 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-VolumesNegativeTest-1954472210-project May 28 17:25:28.963203 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:25:28.963203 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:25:28.963203 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: 3fd43777943042058151ec9ae8479155 May 28 17:25:28.963203 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-VolumesNegativeTest-1954472210-project May 28 17:25:28.963203 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: May 28 17:25:28.963203 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Volume fc63f125-18ed-4ceb-b961-337720af9430 could not be found. May 28 17:25:28.963203 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'id': 'fc63f125-18ed-4ceb-b961-337720af9430'} May 28 17:25:28.963203 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:25:28.965046 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:28.965046 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 17:25:28.965046 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 17:25:28.965046 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 28 17:25:28.965046 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 28 17:25:28.965046 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 28 17:25:28.965046 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 28 17:25:28.965046 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 28 17:25:28.965046 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 28 17:25:28.965046 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 28 17:25:28.965046 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 28 17:25:28.965046 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 17:25:28.965046 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 17:25:28.965046 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 17:25:28.965046 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 17:25:28.965046 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fc63f125-18ed-4ceb-b961-337720af9430 could not be found. (HTTP 404) (Request-ID: req-daf574d4-119d-490d-8765-ce1372a7bd39) May 28 17:25:28.965046 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.965046 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:25:28.965046 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.966471 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:28.966471 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 28 17:25:28.966471 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 28 17:25:28.966471 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 28 17:25:28.966471 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 28 17:25:28.966471 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 28 17:25:28.966471 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 28 17:25:28.966471 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 28 17:25:28.966471 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 28 17:25:28.966471 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 17:25:28.966471 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 17:25:28.966471 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 28 17:25:28.966471 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 28 17:25:28.966471 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 28 17:25:28.966471 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 28 17:25:28.966471 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 28 17:25:28.966471 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 28 17:25:28.966471 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 28 17:25:28.966471 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 28 17:25:28.968201 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 17:25:28.968201 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 17:25:28.968201 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 17:25:28.968201 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 17:25:28.968201 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fc63f125-18ed-4ceb-b961-337720af9430 could not be found. May 28 17:25:28.968201 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.968201 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:25:28.968201 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.968201 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:28.968201 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:25:28.968201 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:25:28.968201 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:25:28.968201 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:25:28.968201 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 17:25:28.968201 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 17:25:28.968201 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:25:28.968201 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:25:28.968201 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 28 17:25:28.968201 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:25:28.970475 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fc63f125-18ed-4ceb-b961-337720af9430 could not be found. May 28 17:25:28.970475 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.970475 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:25:28.970475 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.970475 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:28.970475 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:25:28.970475 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:25:28.970475 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:25:28.970475 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:25:28.970475 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fc63f125-18ed-4ceb-b961-337720af9430 could not be found. May 28 17:25:28.970475 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:28.970475 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5adeb825-4f0f-4c27-b129-2a7951bf5a41 tempest-VolumesNegativeTest-1954472210 tempest-VolumesNegativeTest-1954472210-project] Returning 404 to user: Volume fc63f125-18ed-4ceb-b961-337720af9430 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:25:28.970475 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5adeb825-4f0f-4c27-b129-2a7951bf5a41 tempest-VolumesNegativeTest-1954472210 tempest-VolumesNegativeTest-1954472210-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/fc63f125-18ed-4ceb-b961-337720af9430" status: 404 len: 109 microversion: 2.1 time: 0.120270 May 28 17:25:28.972126 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 9/9] 10.222.0.33 () {58 vars in 1247 bytes} [Sat May 28 17:25:28 2022] DELETE /compute/v2.1/os-volumes/fc63f125-18ed-4ceb-b961-337720af9430 => generated 109 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:25:28.991295 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4d9bf151-5029-4772-9d22-a76a91c4dcf1 tempest-VolumesNegativeTest-1954472210 tempest-VolumesNegativeTest-1954472210-project] Calling method '.version_select at 0x7f9efdfea9d0>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:29.069164 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-4d9bf151-5029-4772-9d22-a76a91c4dcf1 tempest-VolumesNegativeTest-1954472210 tempest-VolumesNegativeTest-1954472210-project] HTTP exception thrown: Volume 982ab2c4-edbc-4ffc-b15d-15c58bcbfe6e could not be found. May 28 17:25:29.072137 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4d9bf151-5029-4772-9d22-a76a91c4dcf1 tempest-VolumesNegativeTest-1954472210 tempest-VolumesNegativeTest-1954472210-project] Request method failure captured: May 28 17:25:29.072137 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/os-volumes/982ab2c4-edbc-4ffc-b15d-15c58bcbfe6e HTTP/1.1 May 28 17:25:29.072137 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:25:29.072137 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:25:29.072137 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:25:29.072137 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 0 May 28 17:25:29.072137 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:25:29.072137 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:25:29.072137 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:25:29.072137 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:25:29.072137 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABiklsF5c-gqc6xOpEaCeekHkiVMAeEtAp4RFwdBCjcK42f_OLjF1QrZv4k0_j1YQydU0HKCXcp9hORlQJ-74qZh3YSWvtz0rHg3oBuNqcO9rHbYqtccipZcx9eKH56bqSBalaufgRr2q_ZMqWtx2ryZX4eNXh6SEQGq1FU-oVBNvM8NMU May 28 17:25:29.072137 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:25:29.072137 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:25:29.072137 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:25:29.072137 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:25:29.072137 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:25:29.072137 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:25:29.072137 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: 24240be31473431cb8690f8cb08a3cd5 May 28 17:25:29.072137 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-VolumesNegativeTest-1954472210 May 28 17:25:29.072137 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:25:29.072137 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:25:29.075167 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/24240be31473431cb8690f8cb08a3cd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/24240be31473431cb8690f8cb08a3cd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/24240be31473431cb8690f8cb08a3cd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_24240be31473431cb8690f8cb08a3cd5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:25:29.075167 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-VolumesNegativeTest-1954472210 May 28 17:25:29.075167 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 24240be31473431cb8690f8cb08a3cd5 May 28 17:25:29.075167 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-VolumesNegativeTest-1954472210 May 28 17:25:29.075167 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-VolumesNegativeTest-1954472210-project May 28 17:25:29.075167 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:25:29.075167 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:25:29.075167 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: 3fd43777943042058151ec9ae8479155 May 28 17:25:29.075167 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-VolumesNegativeTest-1954472210-project May 28 17:25:29.075167 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: May 28 17:25:29.075167 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Volume 982ab2c4-edbc-4ffc-b15d-15c58bcbfe6e could not be found. May 28 17:25:29.075167 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'id': '982ab2c4-edbc-4ffc-b15d-15c58bcbfe6e'} May 28 17:25:29.075167 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:25:29.076177 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:29.076177 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 17:25:29.076177 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 17:25:29.076177 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 17:25:29.076177 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 17:25:29.076177 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 17:25:29.076177 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 17:25:29.076177 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 17:25:29.076177 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 17:25:29.076177 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 17:25:29.076177 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 17:25:29.076177 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 17:25:29.076177 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 17:25:29.076177 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 17:25:29.076177 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 17:25:29.076177 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 982ab2c4-edbc-4ffc-b15d-15c58bcbfe6e could not be found. (HTTP 404) (Request-ID: req-5a89583f-672a-4e5b-bfa9-518044d5066f) May 28 17:25:29.076177 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:29.076177 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:25:29.076177 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:29.077544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:29.077544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 28 17:25:29.077544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 28 17:25:29.077544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 28 17:25:29.077544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 28 17:25:29.077544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 28 17:25:29.077544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 28 17:25:29.077544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 28 17:25:29.077544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 28 17:25:29.077544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 17:25:29.077544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 17:25:29.077544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 17:25:29.077544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 17:25:29.077544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 17:25:29.077544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 17:25:29.077544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 17:25:29.077544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 17:25:29.077544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 17:25:29.077544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 17:25:29.080981 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 17:25:29.080981 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 17:25:29.080981 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 17:25:29.080981 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 17:25:29.080981 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 982ab2c4-edbc-4ffc-b15d-15c58bcbfe6e could not be found. May 28 17:25:29.080981 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:29.080981 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:25:29.080981 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:29.080981 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:29.080981 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:25:29.080981 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:25:29.080981 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:25:29.080981 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:25:29.080981 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 17:25:29.080981 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 17:25:29.080981 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:25:29.080981 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:25:29.080981 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 28 17:25:29.080981 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:25:29.084098 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 982ab2c4-edbc-4ffc-b15d-15c58bcbfe6e could not be found. May 28 17:25:29.084098 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:29.084098 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:25:29.084098 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:29.084098 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:29.084098 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:25:29.084098 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:25:29.084098 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:25:29.084098 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:25:29.084098 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 982ab2c4-edbc-4ffc-b15d-15c58bcbfe6e could not be found. May 28 17:25:29.084098 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:29.084098 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4d9bf151-5029-4772-9d22-a76a91c4dcf1 tempest-VolumesNegativeTest-1954472210 tempest-VolumesNegativeTest-1954472210-project] Returning 404 to user: Volume 982ab2c4-edbc-4ffc-b15d-15c58bcbfe6e could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:25:29.084098 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-4d9bf151-5029-4772-9d22-a76a91c4dcf1 tempest-VolumesNegativeTest-1954472210 tempest-VolumesNegativeTest-1954472210-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/982ab2c4-edbc-4ffc-b15d-15c58bcbfe6e" status: 404 len: 109 microversion: 2.1 time: 0.102365 May 28 17:25:29.084098 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 10/10] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 17:25:28 2022] GET /compute/v2.1/os-volumes/982ab2c4-edbc-4ffc-b15d-15c58bcbfe6e => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 17:25:29.592899 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5b9b0d85-09bf-4325-a3d3-c6b7a52a0da9 tempest-VolumesTestJSON-1408166726 tempest-VolumesTestJSON-1408166726-project] Calling method '.version_select at 0x7f9efe015f70>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:29.612289 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-169bb4ac-8e90-4af0-976e-8457b94805fe tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Flavor limits 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 17:25:29.612829 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-169bb4ac-8e90-4af0-976e-8457b94805fe tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Image limits 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 17:25:29.613243 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-169bb4ac-8e90-4af0-976e-8457b94805fe tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Flavor pref 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 17:25:29.613853 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-169bb4ac-8e90-4af0-976e-8457b94805fe tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Image pref 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 17:25:29.614578 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-169bb4ac-8e90-4af0-976e-8457b94805fe tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 17:25:29.643952 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-169bb4ac-8e90-4af0-976e-8457b94805fe tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:29.644714 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-169bb4ac-8e90-4af0-976e-8457b94805fe tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:29.646448 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-169bb4ac-8e90-4af0-976e-8457b94805fe tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:29.647857 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-169bb4ac-8e90-4af0-976e-8457b94805fe tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:29.721050 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5b9b0d85-09bf-4325-a3d3-c6b7a52a0da9 tempest-VolumesTestJSON-1408166726 tempest-VolumesTestJSON-1408166726-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/0a71e3b0-9212-47d8-a239-956a8611871d" status: 200 len: 351 microversion: 2.1 time: 0.132729 May 28 17:25:29.721609 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 11/11] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 17:25:29 2022] GET /compute/v2.1/os-volumes/0a71e3b0-9212-47d8-a239-956a8611871d => generated 351 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:25:29.734759 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-153cf5b9-5dc9-4d6a-83d2-17a540cc40e4 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] Calling method '.version_select at 0x7f9efe055940>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:29.793245 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-169bb4ac-8e90-4af0-976e-8457b94805fe tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Getting quotas for project 1a433429eb484bd4b1dae47092f38c2a. Resources: {'instances', 'cores', 'ram'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:25:29.828296 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-169bb4ac-8e90-4af0-976e-8457b94805fe tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Getting quotas for user e21616bf7b5c44e6ad6a8c4a9cc6d8af and project 1a433429eb484bd4b1dae47092f38c2a. Resources: {'instances', 'cores', 'ram'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:25:29.872026 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-169bb4ac-8e90-4af0-976e-8457b94805fe tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Going to run 1 instances... {{(pid=117605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 17:25:29.881915 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-169bb4ac-8e90-4af0-976e-8457b94805fe tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b2aab55c-a793-472a-bc32-81af689ad609',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 17:25:29.926977 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-153cf5b9-5dc9-4d6a-83d2-17a540cc40e4 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f" status: 200 len: 345 microversion: 2.1 time: 0.197552 May 28 17:25:29.935061 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 12/12] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 17:25:29 2022] GET /compute/v2.1/os-volumes/3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f => generated 345 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:25:29.940668 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4adcbdeb-670b-4041-af67-f31c57842696 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] Action: 'create', calling method: .version_select at 0x7f9efe015dc0>, body: {"snapshot": {"volume_id": "3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1048231732"}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:25:30.164388 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-169bb4ac-8e90-4af0-976e-8457b94805fe tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.898038 May 28 17:25:30.165792 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 1/13] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 17:25:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 4901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 17:25:30.206204 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-50a57aa4-0e65-4a40-8257-7f512b7d0fa8 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:30.207046 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-50a57aa4-0e65-4a40-8257-7f512b7d0fa8 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:25:30.570230 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-4adcbdeb-670b-4041-af67-f31c57842696 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.633714 May 28 17:25:30.577271 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-50a57aa4-0e65-4a40-8257-7f512b7d0fa8 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:25:30.578560 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 13/14] 10.222.0.33 () {60 vars in 1161 bytes} [Sat May 28 17:25:29 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:25:30.584681 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3c365f05-4818-4da0-9860-c562aed77767 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] Calling method '.version_select at 0x7f9efe041d30>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:30.615145 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-50a57aa4-0e65-4a40-8257-7f512b7d0fa8 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1215 microversion: 2.1 time: 0.436213 May 28 17:25:30.631130 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 2/15] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:25:30 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1215 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:25:30.670351 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3c365f05-4818-4da0-9860-c562aed77767 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/9f2e749e-a343-4aab-becd-d93f76471dad" status: 200 len: 287 microversion: 2.1 time: 0.089428 May 28 17:25:30.676652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 14/16] 10.222.0.33 () {58 vars in 1250 bytes} [Sat May 28 17:25:30 2022] GET /compute/v2.1/os-snapshots/9f2e749e-a343-4aab-becd-d93f76471dad => generated 287 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:25:30.681583 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ea409c1a-d820-4095-a90f-212be5494086 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] Calling method '.version_select at 0x7f9efd788f70>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:30.847724 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ea409c1a-d820-4095-a90f-212be5494086 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.169925 May 28 17:25:30.849965 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 3/17] 10.222.0.33 () {58 vars in 1139 bytes} [Sat May 28 17:25:30 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:25:30.861333 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c12959d1-2f4b-4bc7-9542-c425fe10d9dc tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] Calling method '.version_select at 0x7f9efe010550>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:31.004896 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c12959d1-2f4b-4bc7-9542-c425fe10d9dc tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/9f2e749e-a343-4aab-becd-d93f76471dad" status: 200 len: 287 microversion: 2.1 time: 0.147342 May 28 17:25:31.007567 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 15/18] 10.222.0.33 () {58 vars in 1250 bytes} [Sat May 28 17:25:30 2022] GET /compute/v2.1/os-snapshots/9f2e749e-a343-4aab-becd-d93f76471dad => generated 287 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:25:31.642715 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-22c3b52c-001c-49be-ab1f-58c6f959577d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:31.643672 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-22c3b52c-001c-49be-ab1f-58c6f959577d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:25:31.936179 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-22c3b52c-001c-49be-ab1f-58c6f959577d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:25:31.946228 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-22c3b52c-001c-49be-ab1f-58c6f959577d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1215 microversion: 2.1 time: 0.310733 May 28 17:25:31.958878 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 4/19] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:25:31 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1215 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:25:32.018632 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-efce1f24-acb7-4688-ad46-c83e5ec5a2da tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] Calling method '.version_select at 0x7f9efe9d40d0>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:32.099211 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-efce1f24-acb7-4688-ad46-c83e5ec5a2da tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/9f2e749e-a343-4aab-becd-d93f76471dad" status: 200 len: 287 microversion: 2.1 time: 0.085409 May 28 17:25:32.100362 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 16/20] 10.222.0.33 () {58 vars in 1250 bytes} [Sat May 28 17:25:32 2022] GET /compute/v2.1/os-snapshots/9f2e749e-a343-4aab-becd-d93f76471dad => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:25:32.966283 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-af9bd116-4f7e-4ab8-8266-41a1ba4e3bc7 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:32.967706 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-af9bd116-4f7e-4ab8-8266-41a1ba4e3bc7 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:25:32.984040 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-af9bd116-4f7e-4ab8-8266-41a1ba4e3bc7 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:32.985083 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-af9bd116-4f7e-4ab8-8266-41a1ba4e3bc7 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:32.986220 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-af9bd116-4f7e-4ab8-8266-41a1ba4e3bc7 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:32.986903 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-af9bd116-4f7e-4ab8-8266-41a1ba4e3bc7 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:33.111304 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-78563d3e-e27b-4535-9c83-3a61e6983efc tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] Calling method '.version_select at 0x7f9efe015b80>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:33.162357 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-78563d3e-e27b-4535-9c83-3a61e6983efc tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/9f2e749e-a343-4aab-becd-d93f76471dad" status: 200 len: 287 microversion: 2.1 time: 0.054684 May 28 17:25:33.163627 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 17/21] 10.222.0.33 () {58 vars in 1250 bytes} [Sat May 28 17:25:33 2022] GET /compute/v2.1/os-snapshots/9f2e749e-a343-4aab-becd-d93f76471dad => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:25:33.375678 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-af9bd116-4f7e-4ab8-8266-41a1ba4e3bc7 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:25:33.395487 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-af9bd116-4f7e-4ab8-8266-41a1ba4e3bc7 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1219 microversion: 2.1 time: 0.434540 May 28 17:25:33.396462 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 5/22] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:25:32 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1219 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:25:34.176295 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-10b3bc62-118e-44e0-9c25-cd617902f86a tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] Calling method '.version_select at 0x7f9efe0158b0>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:34.244324 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-10b3bc62-118e-44e0-9c25-cd617902f86a tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/9f2e749e-a343-4aab-becd-d93f76471dad" status: 200 len: 287 microversion: 2.1 time: 0.072851 May 28 17:25:34.245926 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 18/23] 10.222.0.33 () {58 vars in 1250 bytes} [Sat May 28 17:25:34 2022] GET /compute/v2.1/os-snapshots/9f2e749e-a343-4aab-becd-d93f76471dad => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:25:34.414326 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f0e18954-baa5-414a-8868-d7f163af3086 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:34.415104 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f0e18954-baa5-414a-8868-d7f163af3086 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:25:34.429339 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f0e18954-baa5-414a-8868-d7f163af3086 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:34.429705 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f0e18954-baa5-414a-8868-d7f163af3086 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:34.430491 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f0e18954-baa5-414a-8868-d7f163af3086 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:34.437912 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f0e18954-baa5-414a-8868-d7f163af3086 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:34.633670 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f0e18954-baa5-414a-8868-d7f163af3086 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:25:34.642996 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f0e18954-baa5-414a-8868-d7f163af3086 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1219 microversion: 2.1 time: 0.232456 May 28 17:25:34.645733 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 6/24] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:25:34 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1219 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:25:35.258842 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1be9c536-d041-49f1-9f0f-40887cafaf80 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] Calling method '.version_select at 0x7f9efe010160>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:35.318029 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1be9c536-d041-49f1-9f0f-40887cafaf80 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/9f2e749e-a343-4aab-becd-d93f76471dad" status: 200 len: 287 microversion: 2.1 time: 0.064814 May 28 17:25:35.319111 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 19/25] 10.222.0.33 () {58 vars in 1250 bytes} [Sat May 28 17:25:35 2022] GET /compute/v2.1/os-snapshots/9f2e749e-a343-4aab-becd-d93f76471dad => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:25:35.663300 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a91a0405-7889-4e12-b09e-e10a3ddb0729 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:35.671407 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a91a0405-7889-4e12-b09e-e10a3ddb0729 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:25:35.692729 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a91a0405-7889-4e12-b09e-e10a3ddb0729 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:35.693934 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a91a0405-7889-4e12-b09e-e10a3ddb0729 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:35.696998 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a91a0405-7889-4e12-b09e-e10a3ddb0729 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:35.697608 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a91a0405-7889-4e12-b09e-e10a3ddb0729 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:36.295983 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a91a0405-7889-4e12-b09e-e10a3ddb0729 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:25:36.312320 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a91a0405-7889-4e12-b09e-e10a3ddb0729 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1219 microversion: 2.1 time: 0.654015 May 28 17:25:36.315633 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 7/26] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:25:35 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1219 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:25:36.334987 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9ba0754c-db4e-49cf-aa78-69c8bcf3cea8 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] Calling method '.version_select at 0x7f9efe015280>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:36.494378 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9ba0754c-db4e-49cf-aa78-69c8bcf3cea8 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/9f2e749e-a343-4aab-becd-d93f76471dad" status: 200 len: 287 microversion: 2.1 time: 0.167996 May 28 17:25:36.495578 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 20/27] 10.222.0.33 () {58 vars in 1250 bytes} [Sat May 28 17:25:36 2022] GET /compute/v2.1/os-snapshots/9f2e749e-a343-4aab-becd-d93f76471dad => generated 287 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:25:37.069036 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d691b82a-fc38-43c0-9ef5-67def6fa4ef3 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Action: 'create', calling method: .version_select at 0x7f9efce91af0>, body: {"keypair": {"name": "tempest-keypair-824016868", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvxYFjMHPLYxByK8mPWoaqZU5p746kejTbaW6SlxsDN8BVqZtqCwkKjrt9VOFPATGBmhZaAYLE449UVqRDW9w5c56E6FCxH1YmtUYARfwjwK0IqtfEidr0MAGT8odtycA=="}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:25:37.109212 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-d691b82a-fc38-43c0-9ef5-67def6fa4ef3 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Getting quotas for project 90b378551d1c467e911cf01274c97d85. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:25:37.113207 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-d691b82a-fc38-43c0-9ef5-67def6fa4ef3 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Getting quotas for user 7fcc62869ac34381a2327be46511137b and project 90b378551d1c467e911cf01274c97d85. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:25:37.196330 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d691b82a-fc38-43c0-9ef5-67def6fa4ef3 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.575881 May 28 17:25:37.198129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 8/28] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 17:25:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:25:37.333851 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4bdf4414-beca-4231-a1a1-09c628f97476 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:37.338368 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-4bdf4414-beca-4231-a1a1-09c628f97476 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:25:37.386939 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4bdf4414-beca-4231-a1a1-09c628f97476 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:37.391016 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4bdf4414-beca-4231-a1a1-09c628f97476 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:37.397909 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4bdf4414-beca-4231-a1a1-09c628f97476 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:37.398517 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4bdf4414-beca-4231-a1a1-09c628f97476 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:37.412736 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1b245144-6fab-4410-bc97-e5af43fa3e24 tempest-VolumesTestJSON-1408166726 tempest-VolumesTestJSON-1408166726-project] Calling method '.version_select at 0x7f9efce91430>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:37.570524 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1b245144-6fab-4410-bc97-e5af43fa3e24 tempest-VolumesTestJSON-1408166726 tempest-VolumesTestJSON-1408166726-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f49e76c5-5c73-430c-bbb8-8a239cc0ac1e" status: 200 len: 350 microversion: 2.1 time: 0.161480 May 28 17:25:37.577664 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 9/29] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 17:25:37 2022] GET /compute/v2.1/os-volumes/f49e76c5-5c73-430c-bbb8-8a239cc0ac1e => generated 350 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:25:37.577664 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e15a2f5b-99be-4a14-a3a5-8ead885f3ca1 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] Calling method '.version_select at 0x7f9efce8a0d0>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:37.718287 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-e15a2f5b-99be-4a14-a3a5-8ead885f3ca1 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/9f2e749e-a343-4aab-becd-d93f76471dad" status: 200 len: 288 microversion: 2.1 time: 0.145530 May 28 17:25:37.718982 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 10/30] 10.222.0.33 () {58 vars in 1250 bytes} [Sat May 28 17:25:37 2022] GET /compute/v2.1/os-snapshots/9f2e749e-a343-4aab-becd-d93f76471dad => generated 288 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:25:37.729492 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-54742a58-7dd9-4149-929c-0ecbea2f9151 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] Calling method '.version_select at 0x7f9efce91430>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:37.896233 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-54742a58-7dd9-4149-929c-0ecbea2f9151 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/9f2e749e-a343-4aab-becd-d93f76471dad" status: 202 len: 0 microversion: 2.1 time: 0.170502 May 28 17:25:37.899771 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 11/31] 10.222.0.33 () {58 vars in 1253 bytes} [Sat May 28 17:25:37 2022] DELETE /compute/v2.1/os-snapshots/9f2e749e-a343-4aab-becd-d93f76471dad => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 17:25:37.905656 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-bd84d3d8-cd11-45ad-88b8-a763fa41b751 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] Calling method '.version_select at 0x7f9efce8a820>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:37.992673 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-bd84d3d8-cd11-45ad-88b8-a763fa41b751 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/9f2e749e-a343-4aab-becd-d93f76471dad" status: 200 len: 287 microversion: 2.1 time: 0.090687 May 28 17:25:37.998242 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 12/32] 10.222.0.33 () {58 vars in 1250 bytes} [Sat May 28 17:25:37 2022] GET /compute/v2.1/os-snapshots/9f2e749e-a343-4aab-becd-d93f76471dad => generated 287 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:25:38.215177 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-4bdf4414-beca-4231-a1a1-09c628f97476 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:25:38.277126 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-4bdf4414-beca-4231-a1a1-09c628f97476 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1275 microversion: 2.1 time: 0.948646 May 28 17:25:38.289054 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 21/33] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:25:37 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1275 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:25:39.005561 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-df859d93-d116-4368-b5ff-cdf6e564ea10 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] Calling method '.version_select at 0x7f9efce8a8b0>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:39.067887 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-df859d93-d116-4368-b5ff-cdf6e564ea10 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] HTTP exception thrown: Snapshot 9f2e749e-a343-4aab-becd-d93f76471dad could not be found. May 28 17:25:39.072372 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-df859d93-d116-4368-b5ff-cdf6e564ea10 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] Request method failure captured: May 28 17:25:39.072372 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/os-snapshots/9f2e749e-a343-4aab-becd-d93f76471dad HTTP/1.1 May 28 17:25:39.072372 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept: application/json May 28 17:25:39.072372 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity May 28 17:25:39.072372 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Connection: close May 28 17:25:39.072372 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Length: 0 May 28 17:25:39.072372 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Type: application/json May 28 17:25:39.072372 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 May 28 17:25:39.072372 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None May 28 17:25:39.072372 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 May 28 17:25:39.072372 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABiklsEMCxfT3lxpyhxEsDp2E2Ve_wpbx2Soo3dlByvtVL07QPbxyOQyhF8ljfebgkD5jEul6DssyU7DmvvIZWFUV4aLe4Kz-bvElDd20Q8LZI1O6pwG8GNiyp4FjqHLlvAD3aBdePAwIOltxjYVJBbaUFoDWoJryD_MMjglrApnBvjYEg May 28 17:25:39.072372 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Id: None May 28 17:25:39.072372 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Name: None May 28 17:25:39.072372 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed May 28 17:25:39.072372 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True May 28 17:25:39.072372 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default May 28 17:25:39.072372 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default May 28 17:25:39.072372 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Id: 2798e3c92658428f951e104bc6458744 May 28 17:25:39.072372 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-478881491 May 28 17:25:39.072372 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Role: reader,member May 28 17:25:39.072372 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Roles: reader,member May 28 17:25:39.073878 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2798e3c92658428f951e104bc6458744"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2798e3c92658428f951e104bc6458744"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2798e3c92658428f951e104bc6458744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2798e3c92658428f951e104bc6458744", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:25:39.073878 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-VolumesSnapshotsTestJSON-478881491 May 28 17:25:39.073878 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 2798e3c92658428f951e104bc6458744 May 28 17:25:39.073878 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-478881491 May 28 17:25:39.073878 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User: tempest-VolumesSnapshotsTestJSON-478881491-project May 28 17:25:39.073878 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default May 28 17:25:39.073878 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default May 28 17:25:39.073878 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Id: 55f494e6fed84b7485541ef5cd668701 May 28 17:25:39.073878 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-VolumesSnapshotsTestJSON-478881491-project May 28 17:25:39.073878 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: method: May 28 17:25:39.073878 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: exception: Snapshot 9f2e749e-a343-4aab-becd-d93f76471dad could not be found. May 28 17:25:39.073878 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: action_args: {'id': '9f2e749e-a343-4aab-becd-d93f76471dad'} May 28 17:25:39.073878 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:25:39.074620 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:39.074620 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 28 17:25:39.074620 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 28 17:25:39.074620 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 28 17:25:39.074620 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 28 17:25:39.074620 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 28 17:25:39.074620 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 28 17:25:39.074620 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 17:25:39.074620 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 17:25:39.074620 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 17:25:39.074620 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 17:25:39.074620 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 17:25:39.074620 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 17:25:39.074620 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 17:25:39.074620 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 17:25:39.074620 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9f2e749e-a343-4aab-becd-d93f76471dad could not be found. (HTTP 404) (Request-ID: req-ebfa070d-18ac-47d0-be41-0791e6172f87) May 28 17:25:39.074620 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:25:39.074620 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:25:39.075600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:25:39.075600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:39.075600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 28 17:25:39.075600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 28 17:25:39.075600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 28 17:25:39.075600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 28 17:25:39.075600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 28 17:25:39.075600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 28 17:25:39.075600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 28 17:25:39.075600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 28 17:25:39.075600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 28 17:25:39.075600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 28 17:25:39.075600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 28 17:25:39.075600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 28 17:25:39.075600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 28 17:25:39.075600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 28 17:25:39.075600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 17:25:39.075600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 17:25:39.075600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 17:25:39.077129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 17:25:39.077129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 17:25:39.077129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 17:25:39.077129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 17:25:39.077129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 17:25:39.077129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9f2e749e-a343-4aab-becd-d93f76471dad could not be found. May 28 17:25:39.077129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:25:39.077129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:25:39.077129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:25:39.077129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:39.077129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:25:39.077129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:25:39.077129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:25:39.077129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:25:39.077129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 17:25:39.077129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 17:25:39.077129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:25:39.077129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:25:39.077129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 28 17:25:39.077129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:25:39.078141 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9f2e749e-a343-4aab-becd-d93f76471dad could not be found. May 28 17:25:39.078141 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:25:39.078141 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:25:39.078141 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:25:39.078141 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:39.078141 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:25:39.078141 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:25:39.078141 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:25:39.078141 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:25:39.078141 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9f2e749e-a343-4aab-becd-d93f76471dad could not be found. May 28 17:25:39.078141 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:25:39.080755 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-df859d93-d116-4368-b5ff-cdf6e564ea10 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] Returning 404 to user: Snapshot 9f2e749e-a343-4aab-becd-d93f76471dad could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:25:39.081883 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-df859d93-d116-4368-b5ff-cdf6e564ea10 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/9f2e749e-a343-4aab-becd-d93f76471dad" status: 404 len: 111 microversion: 2.1 time: 0.080131 May 28 17:25:39.092135 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f8576fbe-c59f-4176-97ec-54738c8f2ae2 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] Calling method '.version_select at 0x7f9efe055940>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:39.098822 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 13/34] 10.222.0.33 () {58 vars in 1250 bytes} [Sat May 28 17:25:39 2022] GET /compute/v2.1/os-snapshots/9f2e749e-a343-4aab-becd-d93f76471dad => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:25:39.298072 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-eb3b13ac-bfec-45a2-afed-0356a5648bf9 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:39.298771 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-eb3b13ac-bfec-45a2-afed-0356a5648bf9 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:25:39.310671 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-eb3b13ac-bfec-45a2-afed-0356a5648bf9 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:39.311241 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-eb3b13ac-bfec-45a2-afed-0356a5648bf9 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:39.312401 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-eb3b13ac-bfec-45a2-afed-0356a5648bf9 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:39.313361 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-eb3b13ac-bfec-45a2-afed-0356a5648bf9 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:39.343072 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f8576fbe-c59f-4176-97ec-54738c8f2ae2 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f" status: 202 len: 0 microversion: 2.1 time: 0.255291 May 28 17:25:39.347046 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 22/35] 10.222.0.33 () {58 vars in 1247 bytes} [Sat May 28 17:25:39 2022] DELETE /compute/v2.1/os-volumes/3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 17:25:39.352612 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-66779003-7f65-46cd-b84c-55af7579ee99 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] Calling method '.version_select at 0x7f9efdf2bee0>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:39.602598 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-66779003-7f65-46cd-b84c-55af7579ee99 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f" status: 200 len: 344 microversion: 2.1 time: 0.253114 May 28 17:25:39.607171 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 23/36] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 17:25:39 2022] GET /compute/v2.1/os-volumes/3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f => generated 344 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:25:39.615114 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-157b48e6-76e9-4ad3-8555-cfd510867d46 tempest-VolumesTestJSON-1408166726 tempest-VolumesTestJSON-1408166726-project] Calling method '.version_select at 0x7f9efdf2bca0>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:39.686054 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=2 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:25:39.728012 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-eb3b13ac-bfec-45a2-afed-0356a5648bf9 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:25:39.742529 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-eb3b13ac-bfec-45a2-afed-0356a5648bf9 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1273 microversion: 2.1 time: 0.450436 May 28 17:25:39.746334 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 14/37] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:25:39 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1273 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:25:39.802677 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-157b48e6-76e9-4ad3-8555-cfd510867d46 tempest-VolumesTestJSON-1408166726 tempest-VolumesTestJSON-1408166726-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/4a8250a6-7b6f-47fa-8557-36f53abd63ce" status: 200 len: 351 microversion: 2.1 time: 0.194054 May 28 17:25:39.803301 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 24/38] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 17:25:39 2022] GET /compute/v2.1/os-volumes/4a8250a6-7b6f-47fa-8557-36f53abd63ce => generated 351 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:25:39.817963 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2e9d79d0-2405-41fb-9b28-c0be5012f546 tempest-VolumesTestJSON-1408166726 tempest-VolumesTestJSON-1408166726-project] Calling method '.version_select at 0x7f9efc5de790>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:40.064780 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2e9d79d0-2405-41fb-9b28-c0be5012f546 tempest-VolumesTestJSON-1408166726 tempest-VolumesTestJSON-1408166726-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.250315 May 28 17:25:40.066327 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 15/39] 10.222.0.33 () {58 vars in 1133 bytes} [Sat May 28 17:25:39 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:25:40.085399 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-91b0a163-07c3-4bef-908c-ef6c5ed00f09 tempest-VolumesTestJSON-1408166726 tempest-VolumesTestJSON-1408166726-project] Calling method '.version_select at 0x7f9efe055940>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:40.331016 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-91b0a163-07c3-4bef-908c-ef6c5ed00f09 tempest-VolumesTestJSON-1408166726 tempest-VolumesTestJSON-1408166726-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.252572 May 28 17:25:40.340702 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 25/40] 10.222.0.33 () {58 vars in 1148 bytes} [Sat May 28 17:25:40 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:25:40.345894 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-64a28f9a-22fc-4ea6-bf1b-15773f3a2fc8 tempest-VolumesTestJSON-1408166726 tempest-VolumesTestJSON-1408166726-project] Calling method '.version_select at 0x7f9efc5e71f0>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:40.615610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4039f2a4-6c01-4dd9-af97-1817b8944970 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] Calling method '.version_select at 0x7f9efded0c10>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:40.625277 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-64a28f9a-22fc-4ea6-bf1b-15773f3a2fc8 tempest-VolumesTestJSON-1408166726 tempest-VolumesTestJSON-1408166726-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.283826 May 28 17:25:40.630344 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 16/41] 10.222.0.33 () {58 vars in 1133 bytes} [Sat May 28 17:25:40 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:25:40.638538 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4c838f70-4f8d-46e3-ad80-c0a4e674d29b tempest-VolumesTestJSON-1408166726 tempest-VolumesTestJSON-1408166726-project] Calling method '.version_select at 0x7f9efc5de430>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:40.708444 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-4039f2a4-6c01-4dd9-af97-1817b8944970 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] HTTP exception thrown: Volume 3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f could not be found. May 28 17:25:40.710555 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4039f2a4-6c01-4dd9-af97-1817b8944970 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] Request method failure captured: May 28 17:25:40.710555 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/os-volumes/3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f HTTP/1.1 May 28 17:25:40.710555 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:25:40.710555 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:25:40.710555 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:25:40.710555 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 0 May 28 17:25:40.710555 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:25:40.710555 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:25:40.710555 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:25:40.710555 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:25:40.710555 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABiklsEMCxfT3lxpyhxEsDp2E2Ve_wpbx2Soo3dlByvtVL07QPbxyOQyhF8ljfebgkD5jEul6DssyU7DmvvIZWFUV4aLe4Kz-bvElDd20Q8LZI1O6pwG8GNiyp4FjqHLlvAD3aBdePAwIOltxjYVJBbaUFoDWoJryD_MMjglrApnBvjYEg May 28 17:25:40.710555 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:25:40.710555 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:25:40.710555 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:25:40.710555 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:25:40.710555 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:25:40.710555 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:25:40.710555 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: 2798e3c92658428f951e104bc6458744 May 28 17:25:40.710555 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-478881491 May 28 17:25:40.710555 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:25:40.710555 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:25:40.713930 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2798e3c92658428f951e104bc6458744"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2798e3c92658428f951e104bc6458744"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2798e3c92658428f951e104bc6458744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2798e3c92658428f951e104bc6458744", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:25:40.713930 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-VolumesSnapshotsTestJSON-478881491 May 28 17:25:40.713930 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 2798e3c92658428f951e104bc6458744 May 28 17:25:40.713930 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-478881491 May 28 17:25:40.713930 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-VolumesSnapshotsTestJSON-478881491-project May 28 17:25:40.713930 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:25:40.713930 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:25:40.713930 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: 55f494e6fed84b7485541ef5cd668701 May 28 17:25:40.713930 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-VolumesSnapshotsTestJSON-478881491-project May 28 17:25:40.713930 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: May 28 17:25:40.713930 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Volume 3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f could not be found. May 28 17:25:40.713930 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'id': '3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f'} May 28 17:25:40.713930 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:25:40.714632 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:40.714632 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 17:25:40.714632 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 17:25:40.714632 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 17:25:40.714632 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 17:25:40.714632 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 17:25:40.714632 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 17:25:40.714632 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 17:25:40.714632 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 17:25:40.714632 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 17:25:40.714632 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 17:25:40.714632 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 17:25:40.714632 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 17:25:40.714632 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 17:25:40.714632 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 17:25:40.714632 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f could not be found. (HTTP 404) (Request-ID: req-6d90f36a-d594-4926-b3be-5e0faf03978c) May 28 17:25:40.714632 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:40.714632 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:25:40.714632 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:40.715639 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:40.715639 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 28 17:25:40.715639 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 28 17:25:40.715639 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 28 17:25:40.715639 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 28 17:25:40.715639 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 28 17:25:40.715639 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 28 17:25:40.715639 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 28 17:25:40.715639 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 28 17:25:40.715639 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 17:25:40.715639 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 17:25:40.715639 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 17:25:40.715639 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 17:25:40.715639 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 17:25:40.715639 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 17:25:40.715639 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 17:25:40.715639 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 17:25:40.715639 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 17:25:40.715639 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 17:25:40.716554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 17:25:40.716554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 17:25:40.716554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 17:25:40.716554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 17:25:40.716554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f could not be found. May 28 17:25:40.716554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:40.716554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:25:40.716554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:40.716554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:40.716554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:25:40.716554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:25:40.716554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:25:40.716554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:25:40.716554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 17:25:40.716554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 17:25:40.716554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:25:40.716554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:25:40.716554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 28 17:25:40.716554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:25:40.717554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f could not be found. May 28 17:25:40.717554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:40.717554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:25:40.717554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:40.717554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:40.717554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:25:40.717554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:25:40.717554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:25:40.717554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:25:40.717554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f could not be found. May 28 17:25:40.717554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:40.719674 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4039f2a4-6c01-4dd9-af97-1817b8944970 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] Returning 404 to user: Volume 3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:25:40.720757 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-4039f2a4-6c01-4dd9-af97-1817b8944970 tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f" status: 404 len: 109 microversion: 2.1 time: 0.110678 May 28 17:25:40.721777 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 26/42] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 17:25:40 2022] GET /compute/v2.1/os-volumes/3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:25:40.734909 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-61517bd9-19db-4ca6-9686-9e334975571b tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] Calling method '.version_select at 0x7f9efded0670>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:40.916011 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-61517bd9-19db-4ca6-9686-9e334975571b tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] HTTP exception thrown: Volume 3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f could not be found. May 28 17:25:40.918213 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-61517bd9-19db-4ca6-9686-9e334975571b tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] Request method failure captured: May 28 17:25:40.918213 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: DELETE /compute/v2.1/os-volumes/3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f HTTP/1.1 May 28 17:25:40.918213 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:25:40.918213 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:25:40.918213 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:25:40.918213 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 0 May 28 17:25:40.918213 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:25:40.918213 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:25:40.918213 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:25:40.918213 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:25:40.918213 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABiklsEMCxfT3lxpyhxEsDp2E2Ve_wpbx2Soo3dlByvtVL07QPbxyOQyhF8ljfebgkD5jEul6DssyU7DmvvIZWFUV4aLe4Kz-bvElDd20Q8LZI1O6pwG8GNiyp4FjqHLlvAD3aBdePAwIOltxjYVJBbaUFoDWoJryD_MMjglrApnBvjYEg May 28 17:25:40.918213 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:25:40.918213 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:25:40.918213 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:25:40.918213 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:25:40.918213 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:25:40.918213 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:25:40.918213 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: 2798e3c92658428f951e104bc6458744 May 28 17:25:40.918213 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-478881491 May 28 17:25:40.918213 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:25:40.918213 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:25:40.919791 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2798e3c92658428f951e104bc6458744"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2798e3c92658428f951e104bc6458744"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2798e3c92658428f951e104bc6458744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2798e3c92658428f951e104bc6458744", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:25:40.919791 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-VolumesSnapshotsTestJSON-478881491 May 28 17:25:40.919791 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 2798e3c92658428f951e104bc6458744 May 28 17:25:40.919791 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-478881491 May 28 17:25:40.919791 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-VolumesSnapshotsTestJSON-478881491-project May 28 17:25:40.919791 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:25:40.919791 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:25:40.919791 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: 55f494e6fed84b7485541ef5cd668701 May 28 17:25:40.919791 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-VolumesSnapshotsTestJSON-478881491-project May 28 17:25:40.919791 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: May 28 17:25:40.919791 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Volume 3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f could not be found. May 28 17:25:40.919791 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'id': '3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f'} May 28 17:25:40.919791 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:25:40.920610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:40.920610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 17:25:40.920610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 17:25:40.920610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 28 17:25:40.920610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 28 17:25:40.920610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 28 17:25:40.920610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 28 17:25:40.920610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 28 17:25:40.920610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 28 17:25:40.920610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 28 17:25:40.920610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 28 17:25:40.920610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 17:25:40.920610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 17:25:40.920610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 17:25:40.920610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 17:25:40.920610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f could not be found. (HTTP 404) (Request-ID: req-74c57510-cc9e-4977-9001-359979141eb6) May 28 17:25:40.920610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:40.920610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:25:40.920610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:40.921943 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:40.921943 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 28 17:25:40.921943 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 28 17:25:40.921943 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 28 17:25:40.921943 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 28 17:25:40.921943 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 28 17:25:40.921943 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 28 17:25:40.921943 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 28 17:25:40.921943 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 28 17:25:40.921943 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 17:25:40.921943 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 17:25:40.921943 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 28 17:25:40.921943 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 28 17:25:40.921943 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 28 17:25:40.921943 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 28 17:25:40.921943 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 28 17:25:40.921943 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 28 17:25:40.921943 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 28 17:25:40.921943 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 28 17:25:40.923076 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 17:25:40.923076 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 17:25:40.923076 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 17:25:40.923076 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 17:25:40.923076 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f could not be found. May 28 17:25:40.923076 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:40.923076 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:25:40.923076 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:40.923076 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:40.923076 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:25:40.923076 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:25:40.923076 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:25:40.923076 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:25:40.923076 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 17:25:40.923076 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 17:25:40.923076 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:25:40.923076 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:25:40.923076 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 28 17:25:40.923076 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:25:40.924256 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f could not be found. May 28 17:25:40.924256 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:40.924256 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:25:40.924256 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:40.924256 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:40.924256 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:25:40.924256 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:25:40.924256 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:25:40.924256 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:25:40.924256 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f could not be found. May 28 17:25:40.924256 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:40.924256 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-61517bd9-19db-4ca6-9686-9e334975571b tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] Returning 404 to user: Volume 3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:25:40.924256 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-61517bd9-19db-4ca6-9686-9e334975571b tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f" status: 404 len: 109 microversion: 2.1 time: 0.194619 May 28 17:25:40.926166 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 27/43] 10.222.0.33 () {58 vars in 1247 bytes} [Sat May 28 17:25:40 2022] DELETE /compute/v2.1/os-volumes/3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f => generated 109 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:25:40.946993 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b453d12b-27d1-461e-a8ee-66e7789698bb tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:40.947654 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b453d12b-27d1-461e-a8ee-66e7789698bb tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:25:40.981860 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b453d12b-27d1-461e-a8ee-66e7789698bb tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:40.983086 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b453d12b-27d1-461e-a8ee-66e7789698bb tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:40.985015 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b453d12b-27d1-461e-a8ee-66e7789698bb tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:40.993109 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b453d12b-27d1-461e-a8ee-66e7789698bb tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:41.013294 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4c838f70-4f8d-46e3-ad80-c0a4e674d29b tempest-VolumesTestJSON-1408166726 tempest-VolumesTestJSON-1408166726-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.379031 May 28 17:25:41.013864 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 17/44] 10.222.0.33 () {58 vars in 1166 bytes} [Sat May 28 17:25:40 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:25:41.024487 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-dce7be6e-b3bb-43d8-a03a-0325018d77cb tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] Calling method '.version_select at 0x7f9efce48550>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:41.117585 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-dce7be6e-b3bb-43d8-a03a-0325018d77cb tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] HTTP exception thrown: Volume 3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f could not be found. May 28 17:25:41.121142 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-dce7be6e-b3bb-43d8-a03a-0325018d77cb tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] Request method failure captured: May 28 17:25:41.121142 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/os-volumes/3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f HTTP/1.1 May 28 17:25:41.121142 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept: application/json May 28 17:25:41.121142 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity May 28 17:25:41.121142 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Connection: close May 28 17:25:41.121142 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Length: 0 May 28 17:25:41.121142 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Type: application/json May 28 17:25:41.121142 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 May 28 17:25:41.121142 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None May 28 17:25:41.121142 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 May 28 17:25:41.121142 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABiklsEMCxfT3lxpyhxEsDp2E2Ve_wpbx2Soo3dlByvtVL07QPbxyOQyhF8ljfebgkD5jEul6DssyU7DmvvIZWFUV4aLe4Kz-bvElDd20Q8LZI1O6pwG8GNiyp4FjqHLlvAD3aBdePAwIOltxjYVJBbaUFoDWoJryD_MMjglrApnBvjYEg May 28 17:25:41.121142 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Id: None May 28 17:25:41.121142 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Name: None May 28 17:25:41.121142 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed May 28 17:25:41.121142 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True May 28 17:25:41.121142 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default May 28 17:25:41.121142 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default May 28 17:25:41.121142 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Id: 2798e3c92658428f951e104bc6458744 May 28 17:25:41.121142 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-478881491 May 28 17:25:41.121142 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Role: reader,member May 28 17:25:41.121142 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Roles: reader,member May 28 17:25:41.122507 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2798e3c92658428f951e104bc6458744"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2798e3c92658428f951e104bc6458744"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2798e3c92658428f951e104bc6458744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2798e3c92658428f951e104bc6458744", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:25:41.122507 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-VolumesSnapshotsTestJSON-478881491 May 28 17:25:41.122507 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 2798e3c92658428f951e104bc6458744 May 28 17:25:41.122507 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-478881491 May 28 17:25:41.122507 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User: tempest-VolumesSnapshotsTestJSON-478881491-project May 28 17:25:41.122507 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default May 28 17:25:41.122507 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default May 28 17:25:41.122507 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Id: 55f494e6fed84b7485541ef5cd668701 May 28 17:25:41.122507 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-VolumesSnapshotsTestJSON-478881491-project May 28 17:25:41.122507 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: method: May 28 17:25:41.122507 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: exception: Volume 3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f could not be found. May 28 17:25:41.122507 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: action_args: {'id': '3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f'} May 28 17:25:41.122507 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:25:41.126910 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:41.126910 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 17:25:41.126910 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 17:25:41.126910 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 17:25:41.126910 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 17:25:41.126910 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 17:25:41.126910 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 17:25:41.126910 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 17:25:41.126910 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 17:25:41.126910 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 17:25:41.126910 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 17:25:41.126910 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 17:25:41.126910 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 17:25:41.126910 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 17:25:41.126910 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 17:25:41.126910 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f could not be found. (HTTP 404) (Request-ID: req-09f2fb30-f5b4-4586-84da-18c33a829eca) May 28 17:25:41.126910 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:25:41.126910 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:25:41.126910 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:25:41.128904 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:41.128904 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 28 17:25:41.128904 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 28 17:25:41.128904 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 28 17:25:41.128904 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 28 17:25:41.128904 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 28 17:25:41.128904 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 28 17:25:41.128904 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 28 17:25:41.128904 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 28 17:25:41.128904 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 17:25:41.128904 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 17:25:41.128904 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 17:25:41.128904 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 17:25:41.128904 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 17:25:41.128904 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 17:25:41.128904 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 17:25:41.128904 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 17:25:41.128904 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 17:25:41.128904 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 17:25:41.130014 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 17:25:41.130014 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 17:25:41.130014 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 17:25:41.130014 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 17:25:41.130014 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f could not be found. May 28 17:25:41.130014 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:25:41.130014 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:25:41.130014 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:25:41.130014 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:41.130014 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:25:41.130014 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:25:41.130014 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:25:41.130014 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:25:41.130014 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 17:25:41.130014 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 17:25:41.130014 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:25:41.130014 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:25:41.130014 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 28 17:25:41.130014 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:25:41.132483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f could not be found. May 28 17:25:41.132483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:25:41.132483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:25:41.132483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:25:41.132483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:41.132483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:25:41.132483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:25:41.132483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:25:41.132483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:25:41.132483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f could not be found. May 28 17:25:41.132483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:25:41.132483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-dce7be6e-b3bb-43d8-a03a-0325018d77cb tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] Returning 404 to user: Volume 3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:25:41.132483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-dce7be6e-b3bb-43d8-a03a-0325018d77cb tempest-VolumesSnapshotsTestJSON-478881491 tempest-VolumesSnapshotsTestJSON-478881491-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f" status: 404 len: 109 microversion: 2.1 time: 0.106979 May 28 17:25:41.132483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 18/45] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 17:25:41 2022] GET /compute/v2.1/os-volumes/3a97330c-f60a-4f8e-a3c9-fbdf15c62c1f => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:25:41.145082 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-12de058b-e28c-4003-9795-b55d6d08b6d6 tempest-VolumesTestJSON-1408166726 tempest-VolumesTestJSON-1408166726-project] Calling method '.version_select at 0x7f9efce48430>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:41.395953 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b453d12b-27d1-461e-a8ee-66e7789698bb tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:25:41.416115 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b453d12b-27d1-461e-a8ee-66e7789698bb tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1273 microversion: 2.1 time: 0.482238 May 28 17:25:41.419203 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 28/46] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:25:40 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1273 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:25:41.521868 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-12de058b-e28c-4003-9795-b55d6d08b6d6 tempest-VolumesTestJSON-1408166726 tempest-VolumesTestJSON-1408166726-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.396465 May 28 17:25:41.522907 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 19/47] 10.222.0.33 () {58 vars in 1169 bytes} [Sat May 28 17:25:41 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:25:41.537591 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c1d2c0be-f2e1-4448-b38c-5bb77e01356c tempest-VolumesTestJSON-1408166726 tempest-VolumesTestJSON-1408166726-project] Calling method '.version_select at 0x7f9efded0430>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:41.826147 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c1d2c0be-f2e1-4448-b38c-5bb77e01356c tempest-VolumesTestJSON-1408166726 tempest-VolumesTestJSON-1408166726-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.293593 May 28 17:25:41.836179 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 29/48] 10.222.0.33 () {58 vars in 1154 bytes} [Sat May 28 17:25:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:25:41.842816 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b3ca2e98-ce50-470a-a542-717661e668c8 tempest-VolumesTestJSON-1408166726 tempest-VolumesTestJSON-1408166726-project] Calling method '.version_select at 0x7f9efc5de9d0>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:42.194424 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b3ca2e98-ce50-470a-a542-717661e668c8 tempest-VolumesTestJSON-1408166726 tempest-VolumesTestJSON-1408166726-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.358541 May 28 17:25:42.196652 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 20/49] 10.222.0.33 () {58 vars in 1187 bytes} [Sat May 28 17:25:41 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:25:42.212390 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ce4ed158-2369-4b0b-8b7d-604003849789 tempest-VolumesTestJSON-1408166726 tempest-VolumesTestJSON-1408166726-project] Calling method '.version_select at 0x7f9efe041e50>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:42.443282 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ce4ed158-2369-4b0b-8b7d-604003849789 tempest-VolumesTestJSON-1408166726 tempest-VolumesTestJSON-1408166726-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.235434 May 28 17:25:42.450392 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 30/50] 10.222.0.33 () {58 vars in 1154 bytes} [Sat May 28 17:25:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:25:42.451843 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-de4a5ddc-7cf9-4749-98ef-f5adae125b0f tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:42.452752 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-de4a5ddc-7cf9-4749-98ef-f5adae125b0f tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:25:42.467029 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-de4a5ddc-7cf9-4749-98ef-f5adae125b0f tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:42.467684 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-de4a5ddc-7cf9-4749-98ef-f5adae125b0f tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:42.468790 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-de4a5ddc-7cf9-4749-98ef-f5adae125b0f tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:42.469383 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-de4a5ddc-7cf9-4749-98ef-f5adae125b0f tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:42.786752 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1a59bd10-74d4-45f2-a979-86aa936aadfb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1872611999", "imageRef": "b2aab55c-a793-472a-bc32-81af689ad609", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:25:42.978981 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.network.neutron [None req-1a59bd10-74d4-45f2-a979-86aa936aadfb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] validate_networks() for [('77a1ea92-c07d-41a7-8668-7c3c660591aa', None, None, None, None, None)] {{(pid=117605) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 17:25:44.259080 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-de4a5ddc-7cf9-4749-98ef-f5adae125b0f tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:25:44.272639 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-de4a5ddc-7cf9-4749-98ef-f5adae125b0f tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1315 microversion: 2.1 time: 1.825660 May 28 17:25:44.275624 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 31/51] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:25:42 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1315 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:25:45.200462 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-1a59bd10-74d4-45f2-a979-86aa936aadfb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Flavor limits 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 17:25:45.201065 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-1a59bd10-74d4-45f2-a979-86aa936aadfb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Image limits 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 17:25:45.201723 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-1a59bd10-74d4-45f2-a979-86aa936aadfb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Flavor pref 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 17:25:45.202316 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-1a59bd10-74d4-45f2-a979-86aa936aadfb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Image pref 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 17:25:45.202961 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-1a59bd10-74d4-45f2-a979-86aa936aadfb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 17:25:45.230710 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1a59bd10-74d4-45f2-a979-86aa936aadfb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:45.232123 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1a59bd10-74d4-45f2-a979-86aa936aadfb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:45.238472 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1a59bd10-74d4-45f2-a979-86aa936aadfb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:45.240395 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1a59bd10-74d4-45f2-a979-86aa936aadfb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:45.293165 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-dab3e3d8-3ad5-438e-be78-9a22caf29d96 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:45.293165 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-dab3e3d8-3ad5-438e-be78-9a22caf29d96 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:25:45.301293 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dab3e3d8-3ad5-438e-be78-9a22caf29d96 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:45.301911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dab3e3d8-3ad5-438e-be78-9a22caf29d96 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:45.303462 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dab3e3d8-3ad5-438e-be78-9a22caf29d96 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:45.305580 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dab3e3d8-3ad5-438e-be78-9a22caf29d96 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:45.357355 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-1a59bd10-74d4-45f2-a979-86aa936aadfb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Getting quotas for project 8e92a5dc387f47c99ce98da4d6fd9d92. Resources: {'instances', 'cores', 'ram'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:25:45.370903 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-1a59bd10-74d4-45f2-a979-86aa936aadfb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Getting quotas for user 927f21ef1ca74ec58f85181728933e82 and project 8e92a5dc387f47c99ce98da4d6fd9d92. Resources: {'instances', 'cores', 'ram'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:25:45.435372 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1a59bd10-74d4-45f2-a979-86aa936aadfb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Going to run 1 instances... {{(pid=117605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 17:25:45.442686 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1a59bd10-74d4-45f2-a979-86aa936aadfb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b2aab55c-a793-472a-bc32-81af689ad609',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 17:25:45.748566 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1a59bd10-74d4-45f2-a979-86aa936aadfb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.424433 May 28 17:25:45.749272 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 21/52] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 17:25:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 3427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 17:25:45.777952 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-38a7729d-75f9-464c-9127-c6d29632a3f2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1337208139", "imageRef": "b2aab55c-a793-472a-bc32-81af689ad609", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ef03f64f-43e2-4121-9b36-bf95e66e6156"}], "security_groups": [{"name": "tempest-securitygroup--1452755608"}], "key_name": "tempest-keypair-824016868", "user_data": "}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:25:45.824614 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-dab3e3d8-3ad5-438e-be78-9a22caf29d96 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:25:45.835482 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-dab3e3d8-3ad5-438e-be78-9a22caf29d96 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1315 microversion: 2.1 time: 0.549352 May 28 17:25:45.836050 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 32/53] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:25:45 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1315 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:25:45.852685 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5331d14d-757b-4710-a8d1-735624748694 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:45.853308 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5331d14d-757b-4710-a8d1-735624748694 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:25:46.045604 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5331d14d-757b-4710-a8d1-735624748694 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:25:46.097312 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5331d14d-757b-4710-a8d1-735624748694 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1222 microversion: 2.1 time: 0.260172 May 28 17:25:46.097906 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 33/54] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:25:45 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1222 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:25:46.319886 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.network.neutron [None req-38a7729d-75f9-464c-9127-c6d29632a3f2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] validate_networks() for [('ef03f64f-43e2-4121-9b36-bf95e66e6156', None, None, None, None, None)] {{(pid=117605) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 17:25:46.426623 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a60dd2dc-2485-4f49-b2b4-22d773f64f4a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-714520044", "imageRef": "b2aab55c-a793-472a-bc32-81af689ad609", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:25:46.674547 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.network.neutron [None req-a60dd2dc-2485-4f49-b2b4-22d773f64f4a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] validate_networks() for [('77a1ea92-c07d-41a7-8668-7c3c660591aa', None, None, None, None, None)] {{(pid=117604) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 17:25:49.272438 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-38a7729d-75f9-464c-9127-c6d29632a3f2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Flavor limits 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 17:25:49.273222 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-38a7729d-75f9-464c-9127-c6d29632a3f2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Image limits 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 17:25:49.273309 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-38a7729d-75f9-464c-9127-c6d29632a3f2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Flavor pref 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 17:25:49.273665 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-38a7729d-75f9-464c-9127-c6d29632a3f2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Image pref 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 17:25:49.274078 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-38a7729d-75f9-464c-9127-c6d29632a3f2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 17:25:49.292296 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-38a7729d-75f9-464c-9127-c6d29632a3f2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:49.292872 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-38a7729d-75f9-464c-9127-c6d29632a3f2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:49.293687 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-38a7729d-75f9-464c-9127-c6d29632a3f2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:49.294123 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-38a7729d-75f9-464c-9127-c6d29632a3f2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:49.334852 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-38a7729d-75f9-464c-9127-c6d29632a3f2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Getting quotas for project 90b378551d1c467e911cf01274c97d85. Resources: {'instances', 'cores', 'ram'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:25:49.342508 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-38a7729d-75f9-464c-9127-c6d29632a3f2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Getting quotas for user 7fcc62869ac34381a2327be46511137b and project 90b378551d1c467e911cf01274c97d85. Resources: {'instances', 'cores', 'ram'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:25:49.382590 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-38a7729d-75f9-464c-9127-c6d29632a3f2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Going to run 1 instances... {{(pid=117605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 17:25:49.385542 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-38a7729d-75f9-464c-9127-c6d29632a3f2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b2aab55c-a793-472a-bc32-81af689ad609',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 17:25:49.555827 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-38a7729d-75f9-464c-9127-c6d29632a3f2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.802547 May 28 17:25:49.558834 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 22/55] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 17:25:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 3807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 17:25:49.569201 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-eb3f5906-4a62-48c3-bb85-f3dd1c77c424 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:49.572240 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-eb3f5906-4a62-48c3-bb85-f3dd1c77c424 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:25:49.606870 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-eb3f5906-4a62-48c3-bb85-f3dd1c77c424 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:49.608901 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-eb3f5906-4a62-48c3-bb85-f3dd1c77c424 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:49.611799 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-eb3f5906-4a62-48c3-bb85-f3dd1c77c424 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:49.612656 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-eb3f5906-4a62-48c3-bb85-f3dd1c77c424 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:50.460676 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-a60dd2dc-2485-4f49-b2b4-22d773f64f4a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Flavor limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 17:25:50.461825 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-a60dd2dc-2485-4f49-b2b4-22d773f64f4a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Image limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 17:25:50.462713 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-a60dd2dc-2485-4f49-b2b4-22d773f64f4a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Flavor pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 17:25:50.464154 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-a60dd2dc-2485-4f49-b2b4-22d773f64f4a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Image pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 17:25:50.464862 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-a60dd2dc-2485-4f49-b2b4-22d773f64f4a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 17:25:50.500593 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a60dd2dc-2485-4f49-b2b4-22d773f64f4a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:50.502051 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a60dd2dc-2485-4f49-b2b4-22d773f64f4a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:50.503580 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a60dd2dc-2485-4f49-b2b4-22d773f64f4a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:50.504317 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a60dd2dc-2485-4f49-b2b4-22d773f64f4a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:50.568696 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-a60dd2dc-2485-4f49-b2b4-22d773f64f4a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Getting quotas for project 8e92a5dc387f47c99ce98da4d6fd9d92. Resources: {'instances', 'cores', 'ram'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:25:50.578901 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-a60dd2dc-2485-4f49-b2b4-22d773f64f4a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Getting quotas for user 927f21ef1ca74ec58f85181728933e82 and project 8e92a5dc387f47c99ce98da4d6fd9d92. Resources: {'instances', 'cores', 'ram'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:25:50.597163 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a60dd2dc-2485-4f49-b2b4-22d773f64f4a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Going to run 1 instances... {{(pid=117604) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 17:25:50.600827 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a60dd2dc-2485-4f49-b2b4-22d773f64f4a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b2aab55c-a793-472a-bc32-81af689ad609',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 17:25:50.733130 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a60dd2dc-2485-4f49-b2b4-22d773f64f4a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.310950 May 28 17:25:50.738695 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 34/56] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 17:25:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 4312 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 17:25:51.103189 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-eb3f5906-4a62-48c3-bb85-f3dd1c77c424 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:25:51.122064 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-eb3f5906-4a62-48c3-bb85-f3dd1c77c424 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1315 microversion: 2.1 time: 1.560520 May 28 17:25:51.126055 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 23/57] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:25:49 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1315 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:25:51.516586 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-75dff8a2-8949-4725-bcb5-0b1d2a817afc tempest-VolumesGetTestJSON-613401871 tempest-VolumesGetTestJSON-613401871-project] Action: 'create', calling method: .version_select at 0x7f9efd5b6ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-239163874", "metadata": {"Type": "work"}}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:25:51.840975 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-74fa4494-0cd9-4c7f-acfa-2794f1fd83dc req-b4074a31-d9eb-47b8-81df-c87e99601ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3425b63d-c751-49bf-b2d9-0568c8cdae34", "tag": "484051b7-f005-48d0-a799-a12b167c29db"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:25:51.870758 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-74fa4494-0cd9-4c7f-acfa-2794f1fd83dc req-b4074a31-d9eb-47b8-81df-c87e99601ce7 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:51.886238 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-74fa4494-0cd9-4c7f-acfa-2794f1fd83dc req-b4074a31-d9eb-47b8-81df-c87e99601ce7 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:51.958931 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-74fa4494-0cd9-4c7f-acfa-2794f1fd83dc req-b4074a31-d9eb-47b8-81df-c87e99601ce7 service nova] Creating event network-changed:484051b7-f005-48d0-a799-a12b167c29db for instance 3425b63d-c751-49bf-b2d9-0568c8cdae34 on hv-cinder-84372 May 28 17:25:51.991207 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-74fa4494-0cd9-4c7f-acfa-2794f1fd83dc req-b4074a31-d9eb-47b8-81df-c87e99601ce7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117605) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 28 17:25:51.993864 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b1d3e22c-0307-41dc-aefd-8d6937fbb1e9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:51.998038 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b1d3e22c-0307-41dc-aefd-8d6937fbb1e9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:52.000314 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b1d3e22c-0307-41dc-aefd-8d6937fbb1e9 None None] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:52.008602 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b1d3e22c-0307-41dc-aefd-8d6937fbb1e9 None None] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:52.050540 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.compute.rpcapi [None req-b1d3e22c-0307-41dc-aefd-8d6937fbb1e9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 28 17:25:52.052651 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b1d3e22c-0307-41dc-aefd-8d6937fbb1e9 None None] Releasing lock "compute-rpcapi-router" {{(pid=117605) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 28 17:25:52.141490 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b1d3e22c-0307-41dc-aefd-8d6937fbb1e9 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.012250 May 28 17:25:52.142621 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 24/58] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:25:52.148730 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-622389d1-b4a7-4b79-a6ce-3529f9da8d64 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:52.149576 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-622389d1-b4a7-4b79-a6ce-3529f9da8d64 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:25:52.189273 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-622389d1-b4a7-4b79-a6ce-3529f9da8d64 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:52.192370 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-622389d1-b4a7-4b79-a6ce-3529f9da8d64 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:52.200547 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-622389d1-b4a7-4b79-a6ce-3529f9da8d64 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:52.201366 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-622389d1-b4a7-4b79-a6ce-3529f9da8d64 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:52.690782 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-622389d1-b4a7-4b79-a6ce-3529f9da8d64 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:25:52.700572 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-622389d1-b4a7-4b79-a6ce-3529f9da8d64 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1307 microversion: 2.1 time: 0.556721 May 28 17:25:52.707213 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 25/59] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:25:52 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1307 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:25:52.712594 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5b2bcdcd-d8a5-47e4-b53f-ecb994c260cf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:52.728995 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5b2bcdcd-d8a5-47e4-b53f-ecb994c260cf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:25:52.778410 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5b2bcdcd-d8a5-47e4-b53f-ecb994c260cf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:52.779892 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5b2bcdcd-d8a5-47e4-b53f-ecb994c260cf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:52.780743 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5b2bcdcd-d8a5-47e4-b53f-ecb994c260cf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:52.781250 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5b2bcdcd-d8a5-47e4-b53f-ecb994c260cf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:53.271472 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-75dff8a2-8949-4725-bcb5-0b1d2a817afc tempest-VolumesGetTestJSON-613401871 tempest-VolumesGetTestJSON-613401871-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.536191 May 28 17:25:53.272623 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 35/60] 10.222.0.33 () {60 vars in 1155 bytes} [Sat May 28 17:25:50 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2538 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 28 17:25:53.274470 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5b2bcdcd-d8a5-47e4-b53f-ecb994c260cf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:25:53.277384 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-094a439e-a877-4836-9a60-e236bfa40f4a tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:53.278156 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-094a439e-a877-4836-9a60-e236bfa40f4a tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:25:53.287845 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5b2bcdcd-d8a5-47e4-b53f-ecb994c260cf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1273 microversion: 2.1 time: 0.576069 May 28 17:25:53.289108 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 26/61] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:25:52 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1273 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:25:53.311707 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-61f825bf-9d4f-4ac4-ac9c-da83078dc0d9 tempest-VolumesGetTestJSON-613401871 tempest-VolumesGetTestJSON-613401871-project] Calling method '.version_select at 0x7f9efc5de790>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:53.315768 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-094a439e-a877-4836-9a60-e236bfa40f4a tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:53.324826 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-094a439e-a877-4836-9a60-e236bfa40f4a tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:53.327434 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-094a439e-a877-4836-9a60-e236bfa40f4a tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:53.333953 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-094a439e-a877-4836-9a60-e236bfa40f4a tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:53.469291 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-61f825bf-9d4f-4ac4-ac9c-da83078dc0d9 tempest-VolumesGetTestJSON-613401871 tempest-VolumesGetTestJSON-613401871-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/8fd6ce5a-9647-4b75-b1e2-c3b03de33a0d" status: 200 len: 352 microversion: 2.1 time: 0.178729 May 28 17:25:53.470300 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 27/62] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 17:25:53 2022] GET /compute/v2.1/os-volumes/8fd6ce5a-9647-4b75-b1e2-c3b03de33a0d => generated 352 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:25:53.737482 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-479bd6a0-8003-47b3-b6ef-d30eac76340c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:53.739739 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-479bd6a0-8003-47b3-b6ef-d30eac76340c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:25:53.750694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-479bd6a0-8003-47b3-b6ef-d30eac76340c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:53.753672 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-479bd6a0-8003-47b3-b6ef-d30eac76340c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:53.754769 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-479bd6a0-8003-47b3-b6ef-d30eac76340c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:53.755541 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-479bd6a0-8003-47b3-b6ef-d30eac76340c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:53.801324 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-094a439e-a877-4836-9a60-e236bfa40f4a tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:25:53.815683 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-094a439e-a877-4836-9a60-e236bfa40f4a tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1315 microversion: 2.1 time: 0.541864 May 28 17:25:53.824292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 36/63] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:25:53 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1315 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:25:53.961992 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-479bd6a0-8003-47b3-b6ef-d30eac76340c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:25:53.993188 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-479bd6a0-8003-47b3-b6ef-d30eac76340c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1295 microversion: 2.1 time: 0.270606 May 28 17:25:54.003497 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 28/64] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:25:53 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1295 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:25:54.308775 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d0353923-5eb8-46d7-be4a-d89cb2510a11 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:54.310242 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d0353923-5eb8-46d7-be4a-d89cb2510a11 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:25:54.338935 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d0353923-5eb8-46d7-be4a-d89cb2510a11 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:54.342788 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d0353923-5eb8-46d7-be4a-d89cb2510a11 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:54.343539 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d0353923-5eb8-46d7-be4a-d89cb2510a11 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:54.345631 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d0353923-5eb8-46d7-be4a-d89cb2510a11 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:54.482325 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-62f831e4-523a-44b9-acb8-51badfbe88d8 tempest-VolumesGetTestJSON-613401871 tempest-VolumesGetTestJSON-613401871-project] Calling method '.version_select at 0x7f9efce8a8b0>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:54.554676 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d0353923-5eb8-46d7-be4a-d89cb2510a11 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:25:54.597143 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d0353923-5eb8-46d7-be4a-d89cb2510a11 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1281 microversion: 2.1 time: 0.294579 May 28 17:25:54.600929 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 37/65] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:25:54 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1281 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:25:54.803110 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-62f831e4-523a-44b9-acb8-51badfbe88d8 tempest-VolumesGetTestJSON-613401871 tempest-VolumesGetTestJSON-613401871-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/8fd6ce5a-9647-4b75-b1e2-c3b03de33a0d" status: 200 len: 353 microversion: 2.1 time: 0.325463 May 28 17:25:54.804113 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 29/66] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 17:25:54 2022] GET /compute/v2.1/os-volumes/8fd6ce5a-9647-4b75-b1e2-c3b03de33a0d => generated 353 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:25:54.818275 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-92f85bd1-076d-44d4-b1ea-d126ab16b357 tempest-VolumesGetTestJSON-613401871 tempest-VolumesGetTestJSON-613401871-project] Calling method '.version_select at 0x7f9efd5e4f70>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:54.840452 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-726998a6-e70a-4b77-a170-a762ff0e42c2 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:54.841206 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-726998a6-e70a-4b77-a170-a762ff0e42c2 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:25:54.848129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-726998a6-e70a-4b77-a170-a762ff0e42c2 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:54.848586 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-726998a6-e70a-4b77-a170-a762ff0e42c2 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:54.849400 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-726998a6-e70a-4b77-a170-a762ff0e42c2 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:54.849849 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-726998a6-e70a-4b77-a170-a762ff0e42c2 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:55.019027 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-92f85bd1-076d-44d4-b1ea-d126ab16b357 tempest-VolumesGetTestJSON-613401871 tempest-VolumesGetTestJSON-613401871-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/8fd6ce5a-9647-4b75-b1e2-c3b03de33a0d" status: 200 len: 353 microversion: 2.1 time: 0.207652 May 28 17:25:55.019807 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 38/67] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 17:25:54 2022] GET /compute/v2.1/os-volumes/8fd6ce5a-9647-4b75-b1e2-c3b03de33a0d => generated 353 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:25:55.027646 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c7377d39-6f33-4928-8dad-0ff3fd2d8c5b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:55.028279 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c7377d39-6f33-4928-8dad-0ff3fd2d8c5b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:25:55.050437 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c7377d39-6f33-4928-8dad-0ff3fd2d8c5b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:55.052030 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c7377d39-6f33-4928-8dad-0ff3fd2d8c5b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:55.053371 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c7377d39-6f33-4928-8dad-0ff3fd2d8c5b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:55.055951 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c7377d39-6f33-4928-8dad-0ff3fd2d8c5b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:55.195742 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-726998a6-e70a-4b77-a170-a762ff0e42c2 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:25:55.208199 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-726998a6-e70a-4b77-a170-a762ff0e42c2 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1315 microversion: 2.1 time: 0.372669 May 28 17:25:55.211241 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 30/68] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:25:54 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:25:55.222386 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1c182d46-ecd9-4e4c-91e7-6963684bb3cf tempest-VolumesGetTestJSON-613401871 tempest-VolumesGetTestJSON-613401871-project] Calling method '.version_select at 0x7f9efc5de790>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:55.318477 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c7377d39-6f33-4928-8dad-0ff3fd2d8c5b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:25:55.328176 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c7377d39-6f33-4928-8dad-0ff3fd2d8c5b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1363 microversion: 2.1 time: 0.306677 May 28 17:25:55.347507 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 39/69] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:25:55 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1363 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:25:55.387279 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1c182d46-ecd9-4e4c-91e7-6963684bb3cf tempest-VolumesGetTestJSON-613401871 tempest-VolumesGetTestJSON-613401871-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/8fd6ce5a-9647-4b75-b1e2-c3b03de33a0d" status: 202 len: 0 microversion: 2.1 time: 0.173948 May 28 17:25:55.390821 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 31/70] 10.222.0.33 () {58 vars in 1247 bytes} [Sat May 28 17:25:55 2022] DELETE /compute/v2.1/os-volumes/8fd6ce5a-9647-4b75-b1e2-c3b03de33a0d => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 17:25:55.396241 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-46d6171d-d134-4b90-bca3-4d6f6c364dea tempest-VolumesGetTestJSON-613401871 tempest-VolumesGetTestJSON-613401871-project] Calling method '.version_select at 0x7f9efd5e44c0>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:55.539682 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-46d6171d-d134-4b90-bca3-4d6f6c364dea tempest-VolumesGetTestJSON-613401871 tempest-VolumesGetTestJSON-613401871-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/8fd6ce5a-9647-4b75-b1e2-c3b03de33a0d" status: 200 len: 352 microversion: 2.1 time: 0.147457 May 28 17:25:55.540662 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 40/71] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 17:25:55 2022] GET /compute/v2.1/os-volumes/8fd6ce5a-9647-4b75-b1e2-c3b03de33a0d => generated 352 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:25:55.621350 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b98867ea-f637-4525-bc89-c7c56d948ac3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:55.622194 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-b98867ea-f637-4525-bc89-c7c56d948ac3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:25:55.624762 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=10 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:25:55.632764 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b98867ea-f637-4525-bc89-c7c56d948ac3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:55.633420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b98867ea-f637-4525-bc89-c7c56d948ac3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:55.634203 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b98867ea-f637-4525-bc89-c7c56d948ac3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:55.634748 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b98867ea-f637-4525-bc89-c7c56d948ac3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:55.641609 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=65 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:25:55.706326 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b98867ea-f637-4525-bc89-c7c56d948ac3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:25:55.725699 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b98867ea-f637-4525-bc89-c7c56d948ac3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1281 microversion: 2.1 time: 0.111330 May 28 17:25:55.728071 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 32/72] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:25:55 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1281 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:25:56.228324 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-bfa1d932-2957-4067-8c5e-cd9515db43c8 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:56.229916 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-bfa1d932-2957-4067-8c5e-cd9515db43c8 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:25:56.238390 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bfa1d932-2957-4067-8c5e-cd9515db43c8 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:56.238946 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bfa1d932-2957-4067-8c5e-cd9515db43c8 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:56.239748 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bfa1d932-2957-4067-8c5e-cd9515db43c8 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:56.240349 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bfa1d932-2957-4067-8c5e-cd9515db43c8 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:56.346220 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a5026ab8-0efa-4840-baaa-3581e6c7c7ef tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:56.350691 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a5026ab8-0efa-4840-baaa-3581e6c7c7ef tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:25:56.361976 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a5026ab8-0efa-4840-baaa-3581e6c7c7ef tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:56.363802 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a5026ab8-0efa-4840-baaa-3581e6c7c7ef tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:56.367962 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a5026ab8-0efa-4840-baaa-3581e6c7c7ef tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:56.370510 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a5026ab8-0efa-4840-baaa-3581e6c7c7ef tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:56.595649 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-bfa1d932-2957-4067-8c5e-cd9515db43c8 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:25:56.605504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-bfa1d932-2957-4067-8c5e-cd9515db43c8 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1315 microversion: 2.1 time: 0.382484 May 28 17:25:56.614844 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 41/73] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:25:56 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:25:56.624460 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-34d58708-8960-46d9-ab0e-1b46ae634cc1 tempest-VolumesGetTestJSON-613401871 tempest-VolumesGetTestJSON-613401871-project] Calling method '.version_select at 0x7f9efd5e48b0>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:56.669838 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-34d58708-8960-46d9-ab0e-1b46ae634cc1 tempest-VolumesGetTestJSON-613401871 tempest-VolumesGetTestJSON-613401871-project] HTTP exception thrown: Volume 8fd6ce5a-9647-4b75-b1e2-c3b03de33a0d could not be found. May 28 17:25:56.672847 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-34d58708-8960-46d9-ab0e-1b46ae634cc1 tempest-VolumesGetTestJSON-613401871 tempest-VolumesGetTestJSON-613401871-project] Request method failure captured: May 28 17:25:56.672847 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/os-volumes/8fd6ce5a-9647-4b75-b1e2-c3b03de33a0d HTTP/1.1 May 28 17:25:56.672847 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:25:56.672847 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:25:56.672847 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:25:56.672847 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 0 May 28 17:25:56.672847 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:25:56.672847 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:25:56.672847 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:25:56.672847 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:25:56.672847 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABiklscLnCDNKKK86BN-HhyJpQvnxKF9pOeIx2bCzuxDtEbY7JdsRUeWnM2F4dX_XpjDnm8mY3O1xNp1s21xYNdXNqVv2ZE02QUfJOmFueGxCoJzYamRtHc9BvmZLbdFdMtex4QdgBcXJodqbXdPcnRRth4PJGpuCVfmUWjlJ5LwU__e_g May 28 17:25:56.672847 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:25:56.672847 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:25:56.672847 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:25:56.672847 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:25:56.672847 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:25:56.672847 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:25:56.672847 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: 20b273d3719040838030bf0984f8ac5a May 28 17:25:56.672847 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-VolumesGetTestJSON-613401871 May 28 17:25:56.672847 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:25:56.672847 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:25:56.674151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/20b273d3719040838030bf0984f8ac5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/20b273d3719040838030bf0984f8ac5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/20b273d3719040838030bf0984f8ac5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_20b273d3719040838030bf0984f8ac5a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:25:56.674151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-VolumesGetTestJSON-613401871 May 28 17:25:56.674151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 20b273d3719040838030bf0984f8ac5a May 28 17:25:56.674151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-VolumesGetTestJSON-613401871 May 28 17:25:56.674151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-VolumesGetTestJSON-613401871-project May 28 17:25:56.674151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:25:56.674151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:25:56.674151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: 2b5b5818add6408cabf259b9b035ee2d May 28 17:25:56.674151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-VolumesGetTestJSON-613401871-project May 28 17:25:56.674151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: May 28 17:25:56.674151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Volume 8fd6ce5a-9647-4b75-b1e2-c3b03de33a0d could not be found. May 28 17:25:56.674151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'id': '8fd6ce5a-9647-4b75-b1e2-c3b03de33a0d'} May 28 17:25:56.674151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:25:56.674962 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:56.674962 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 17:25:56.674962 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 17:25:56.674962 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 17:25:56.674962 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 17:25:56.674962 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 17:25:56.674962 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 17:25:56.674962 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 17:25:56.674962 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 17:25:56.674962 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 17:25:56.674962 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 17:25:56.674962 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 17:25:56.674962 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 17:25:56.674962 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 17:25:56.674962 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 17:25:56.674962 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8fd6ce5a-9647-4b75-b1e2-c3b03de33a0d could not be found. (HTTP 404) (Request-ID: req-18a30ae2-62e5-4378-9a7e-2f822380c405) May 28 17:25:56.674962 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:56.674962 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:25:56.674962 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:56.676158 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:56.676158 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 28 17:25:56.676158 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 28 17:25:56.676158 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 28 17:25:56.676158 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 28 17:25:56.676158 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 28 17:25:56.676158 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 28 17:25:56.676158 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 28 17:25:56.676158 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 28 17:25:56.676158 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 17:25:56.676158 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 17:25:56.676158 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 17:25:56.676158 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 17:25:56.676158 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 17:25:56.676158 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 17:25:56.676158 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 17:25:56.676158 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 17:25:56.676158 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 17:25:56.676158 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 17:25:56.678503 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 17:25:56.678503 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 17:25:56.678503 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 17:25:56.678503 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 17:25:56.678503 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8fd6ce5a-9647-4b75-b1e2-c3b03de33a0d could not be found. May 28 17:25:56.678503 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:56.678503 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:25:56.678503 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:56.678503 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:56.678503 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:25:56.678503 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:25:56.678503 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:25:56.678503 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:25:56.678503 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 17:25:56.678503 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 17:25:56.678503 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:25:56.678503 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:25:56.678503 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 28 17:25:56.678503 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:25:56.679523 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8fd6ce5a-9647-4b75-b1e2-c3b03de33a0d could not be found. May 28 17:25:56.679523 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:56.679523 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:25:56.679523 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:56.679523 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:25:56.679523 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:25:56.679523 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:25:56.679523 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:25:56.679523 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:25:56.679523 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8fd6ce5a-9647-4b75-b1e2-c3b03de33a0d could not be found. May 28 17:25:56.679523 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:25:56.679523 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-34d58708-8960-46d9-ab0e-1b46ae634cc1 tempest-VolumesGetTestJSON-613401871 tempest-VolumesGetTestJSON-613401871-project] Returning 404 to user: Volume 8fd6ce5a-9647-4b75-b1e2-c3b03de33a0d could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:25:56.679523 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-34d58708-8960-46d9-ab0e-1b46ae634cc1 tempest-VolumesGetTestJSON-613401871 tempest-VolumesGetTestJSON-613401871-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/8fd6ce5a-9647-4b75-b1e2-c3b03de33a0d" status: 404 len: 109 microversion: 2.1 time: 0.068318 May 28 17:25:56.679523 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 42/74] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 17:25:56 2022] GET /compute/v2.1/os-volumes/8fd6ce5a-9647-4b75-b1e2-c3b03de33a0d => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:25:56.743650 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-53dd4039-2e82-479a-95a1-806d545418b5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:56.744788 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-53dd4039-2e82-479a-95a1-806d545418b5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:25:56.757980 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-53dd4039-2e82-479a-95a1-806d545418b5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:56.758451 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-53dd4039-2e82-479a-95a1-806d545418b5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:56.772371 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-53dd4039-2e82-479a-95a1-806d545418b5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:56.772846 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-53dd4039-2e82-479a-95a1-806d545418b5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:56.957977 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-53dd4039-2e82-479a-95a1-806d545418b5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:25:56.965466 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-53dd4039-2e82-479a-95a1-806d545418b5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1279 microversion: 2.1 time: 0.227150 May 28 17:25:56.975442 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 43/75] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:25:56 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1279 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:25:56.987889 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a5026ab8-0efa-4840-baaa-3581e6c7c7ef tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:25:57.005459 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a5026ab8-0efa-4840-baaa-3581e6c7c7ef tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1363 microversion: 2.1 time: 0.661334 May 28 17:25:57.009205 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 33/76] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:25:56 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1363 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:25:57.625176 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b070ecee-c512-4b68-9381-149a338c23e6 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:57.626522 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b070ecee-c512-4b68-9381-149a338c23e6 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:25:57.644428 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b070ecee-c512-4b68-9381-149a338c23e6 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:57.645127 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b070ecee-c512-4b68-9381-149a338c23e6 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:57.646115 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b070ecee-c512-4b68-9381-149a338c23e6 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:57.651885 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b070ecee-c512-4b68-9381-149a338c23e6 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:57.992642 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f67b3a1d-0ff1-44bb-94ec-fcaaeb6a8767 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:57.993261 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f67b3a1d-0ff1-44bb-94ec-fcaaeb6a8767 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:25:58.001510 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f67b3a1d-0ff1-44bb-94ec-fcaaeb6a8767 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:58.012083 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f67b3a1d-0ff1-44bb-94ec-fcaaeb6a8767 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:58.012925 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f67b3a1d-0ff1-44bb-94ec-fcaaeb6a8767 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:58.013373 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f67b3a1d-0ff1-44bb-94ec-fcaaeb6a8767 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:58.103923 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b070ecee-c512-4b68-9381-149a338c23e6 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:25:58.117972 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b070ecee-c512-4b68-9381-149a338c23e6 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1315 microversion: 2.1 time: 0.498121 May 28 17:25:58.119302 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 44/77] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:25:57 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1315 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:25:58.130929 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-03f9ab48-edad-4280-a1a6-ab510cf2de40 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:58.133306 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-03f9ab48-edad-4280-a1a6-ab510cf2de40 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:25:58.144671 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-03f9ab48-edad-4280-a1a6-ab510cf2de40 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:58.145129 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-03f9ab48-edad-4280-a1a6-ab510cf2de40 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:58.145905 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-03f9ab48-edad-4280-a1a6-ab510cf2de40 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:58.149100 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-03f9ab48-edad-4280-a1a6-ab510cf2de40 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:58.355893 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f67b3a1d-0ff1-44bb-94ec-fcaaeb6a8767 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:25:58.371751 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f67b3a1d-0ff1-44bb-94ec-fcaaeb6a8767 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1279 microversion: 2.1 time: 0.382159 May 28 17:25:58.373129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 34/78] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:25:57 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1279 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:25:58.537224 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-a1de3826-f967-4e63-befd-7a5fd9e1f3cd req-d1e38a8b-ccef-445d-bc63-b7131c03d787 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b3c1f29-31c9-4f5c-9875-fd1939062512", "tag": "d234e00a-5520-40b5-aa3f-c3a3f2a506ee"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:25:58.559510 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-a1de3826-f967-4e63-befd-7a5fd9e1f3cd req-d1e38a8b-ccef-445d-bc63-b7131c03d787 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:58.561040 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-a1de3826-f967-4e63-befd-7a5fd9e1f3cd req-d1e38a8b-ccef-445d-bc63-b7131c03d787 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:58.584182 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-a1de3826-f967-4e63-befd-7a5fd9e1f3cd req-d1e38a8b-ccef-445d-bc63-b7131c03d787 service nova] Creating event network-changed:d234e00a-5520-40b5-aa3f-c3a3f2a506ee for instance 3b3c1f29-31c9-4f5c-9875-fd1939062512 on hv-cinder-84372 May 28 17:25:58.595749 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-a1de3826-f967-4e63-befd-7a5fd9e1f3cd req-d1e38a8b-ccef-445d-bc63-b7131c03d787 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066090 May 28 17:25:58.596521 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 35/79] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:25:58.603663 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-03f9ab48-edad-4280-a1a6-ab510cf2de40 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:25:58.620765 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-03f9ab48-edad-4280-a1a6-ab510cf2de40 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1363 microversion: 2.1 time: 0.498201 May 28 17:25:58.622294 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 45/80] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:25:58 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1363 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:25:59.140592 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-45ef901d-bde0-4f43-b0b4-656f4da4b4cb tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:59.142449 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-45ef901d-bde0-4f43-b0b4-656f4da4b4cb tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:25:59.160800 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-45ef901d-bde0-4f43-b0b4-656f4da4b4cb tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:59.163173 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-45ef901d-bde0-4f43-b0b4-656f4da4b4cb tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:59.165902 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-45ef901d-bde0-4f43-b0b4-656f4da4b4cb tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:59.167887 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-45ef901d-bde0-4f43-b0b4-656f4da4b4cb tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:59.356146 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=26 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:25:59.388355 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-41adbe5f-c0c1-4044-a204-404843c5f73c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:59.389544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-41adbe5f-c0c1-4044-a204-404843c5f73c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:25:59.397796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-41adbe5f-c0c1-4044-a204-404843c5f73c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:59.402966 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-41adbe5f-c0c1-4044-a204-404843c5f73c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:59.404068 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-41adbe5f-c0c1-4044-a204-404843c5f73c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:59.404723 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-41adbe5f-c0c1-4044-a204-404843c5f73c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:59.896936 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-41adbe5f-c0c1-4044-a204-404843c5f73c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:25:59.906214 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-41adbe5f-c0c1-4044-a204-404843c5f73c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.521724 May 28 17:25:59.918082 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 46/81] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:25:59 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:25:59.918082 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e9ea799b-beee-4f6c-8ac9-81b01b279329 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:25:59.918082 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e9ea799b-beee-4f6c-8ac9-81b01b279329 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:25:59.939217 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e9ea799b-beee-4f6c-8ac9-81b01b279329 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:59.941396 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e9ea799b-beee-4f6c-8ac9-81b01b279329 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:59.942305 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e9ea799b-beee-4f6c-8ac9-81b01b279329 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:25:59.942895 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e9ea799b-beee-4f6c-8ac9-81b01b279329 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:25:59.989758 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-45ef901d-bde0-4f43-b0b4-656f4da4b4cb tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:25:59.998683 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-45ef901d-bde0-4f43-b0b4-656f4da4b4cb tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1315 microversion: 2.1 time: 0.864443 May 28 17:26:00.002588 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 36/82] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:25:59 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1315 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:00.302917 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e9ea799b-beee-4f6c-8ac9-81b01b279329 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:00.313658 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e9ea799b-beee-4f6c-8ac9-81b01b279329 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1363 microversion: 2.1 time: 0.403764 May 28 17:26:00.316436 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 47/83] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:25:59 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1363 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:00.748539 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-a1c11ef6-ed8f-4561-8b82-00fc3b745722 req-a9f1197b-b60f-420c-bcad-f302fb2984a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3b0710-2e45-41e0-b02a-a9b95245f62a", "tag": "4e39dc15-aca5-489f-886d-23cd2b05b64d"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:26:00.770191 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-a1c11ef6-ed8f-4561-8b82-00fc3b745722 req-a9f1197b-b60f-420c-bcad-f302fb2984a9 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:00.770649 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-a1c11ef6-ed8f-4561-8b82-00fc3b745722 req-a9f1197b-b60f-420c-bcad-f302fb2984a9 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:00.800691 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-a1c11ef6-ed8f-4561-8b82-00fc3b745722 req-a9f1197b-b60f-420c-bcad-f302fb2984a9 service nova] Creating event network-changed:4e39dc15-aca5-489f-886d-23cd2b05b64d for instance 1c3b0710-2e45-41e0-b02a-a9b95245f62a on hv-cinder-84372 May 28 17:26:00.817874 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-a1c11ef6-ed8f-4561-8b82-00fc3b745722 req-a9f1197b-b60f-420c-bcad-f302fb2984a9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074275 May 28 17:26:00.818496 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 37/84] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:26:00.926248 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e59d8179-8645-41f3-9896-7e1808840e4c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:00.927666 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e59d8179-8645-41f3-9896-7e1808840e4c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:00.933446 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:26:00.935028 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=8 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:26:00.944733 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e59d8179-8645-41f3-9896-7e1808840e4c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:00.953851 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e59d8179-8645-41f3-9896-7e1808840e4c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:00.956828 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e59d8179-8645-41f3-9896-7e1808840e4c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:00.957272 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e59d8179-8645-41f3-9896-7e1808840e4c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:01.020409 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-88f434e4-3a18-4847-812a-35ecfb99c76d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:01.021114 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-88f434e4-3a18-4847-812a-35ecfb99c76d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:01.033542 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-88f434e4-3a18-4847-812a-35ecfb99c76d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:01.036555 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-88f434e4-3a18-4847-812a-35ecfb99c76d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:01.037612 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-88f434e4-3a18-4847-812a-35ecfb99c76d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:01.039898 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-88f434e4-3a18-4847-812a-35ecfb99c76d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:01.446553 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e59d8179-8645-41f3-9896-7e1808840e4c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:01.473884 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-88f434e4-3a18-4847-812a-35ecfb99c76d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:01.476957 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e59d8179-8645-41f3-9896-7e1808840e4c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.555063 May 28 17:26:01.479680 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 48/85] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:00 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:01.483013 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-88f434e4-3a18-4847-812a-35ecfb99c76d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1315 microversion: 2.1 time: 0.466745 May 28 17:26:01.489063 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 38/86] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:01 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1315 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:01.505334 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-20de7c0c-69d1-4dc0-8a82-b44065f3720c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:01.508302 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-20de7c0c-69d1-4dc0-8a82-b44065f3720c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:01.520398 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-20de7c0c-69d1-4dc0-8a82-b44065f3720c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:01.523889 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-20de7c0c-69d1-4dc0-8a82-b44065f3720c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:01.525825 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-20de7c0c-69d1-4dc0-8a82-b44065f3720c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:01.526375 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-20de7c0c-69d1-4dc0-8a82-b44065f3720c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:01.808489 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-20de7c0c-69d1-4dc0-8a82-b44065f3720c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:01.816346 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-20de7c0c-69d1-4dc0-8a82-b44065f3720c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1363 microversion: 2.1 time: 0.335135 May 28 17:26:01.818578 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 49/87] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:01 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1363 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:02.467828 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=6 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:26:02.498260 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5ceac44e-a6ce-471f-92aa-c30f180a6d30 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:02.499052 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5ceac44e-a6ce-471f-92aa-c30f180a6d30 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:02.507018 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5ceac44e-a6ce-471f-92aa-c30f180a6d30 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:02.507520 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5ceac44e-a6ce-471f-92aa-c30f180a6d30 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:02.509021 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5ceac44e-a6ce-471f-92aa-c30f180a6d30 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:02.509609 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5ceac44e-a6ce-471f-92aa-c30f180a6d30 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:02.659933 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-7d20ee64-9056-4fd0-8a00-837bfd4385ea req-de058a0f-6df6-437e-824f-d1cb350fb0d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d6203f1-8344-4493-9b94-22fb56f73a96", "tag": "047a6d17-d6d2-4e8d-afee-99011f7fd562"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:26:02.670114 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-7d20ee64-9056-4fd0-8a00-837bfd4385ea req-de058a0f-6df6-437e-824f-d1cb350fb0d1 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:02.670886 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-7d20ee64-9056-4fd0-8a00-837bfd4385ea req-de058a0f-6df6-437e-824f-d1cb350fb0d1 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:02.688754 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-7d20ee64-9056-4fd0-8a00-837bfd4385ea req-de058a0f-6df6-437e-824f-d1cb350fb0d1 service nova] Creating event network-changed:047a6d17-d6d2-4e8d-afee-99011f7fd562 for instance 9d6203f1-8344-4493-9b94-22fb56f73a96 on hv-cinder-84372 May 28 17:26:02.694466 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-7d20ee64-9056-4fd0-8a00-837bfd4385ea req-de058a0f-6df6-437e-824f-d1cb350fb0d1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.233770 May 28 17:26:02.695539 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 39/88] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:26:02.701144 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4be959e3-7c5e-4610-bc33-5ec84f9c7cf3 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:02.702143 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4be959e3-7c5e-4610-bc33-5ec84f9c7cf3 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:02.708864 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4be959e3-7c5e-4610-bc33-5ec84f9c7cf3 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:02.709571 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4be959e3-7c5e-4610-bc33-5ec84f9c7cf3 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:02.710858 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4be959e3-7c5e-4610-bc33-5ec84f9c7cf3 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:02.711542 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4be959e3-7c5e-4610-bc33-5ec84f9c7cf3 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:02.785436 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5ceac44e-a6ce-471f-92aa-c30f180a6d30 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:02.794913 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5ceac44e-a6ce-471f-92aa-c30f180a6d30 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.303206 May 28 17:26:02.798558 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 50/89] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:02 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:02.836381 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1c0e52bc-4d3e-4653-b913-eb71a935ee7a tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:02.837009 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1c0e52bc-4d3e-4653-b913-eb71a935ee7a tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:02.849613 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c0e52bc-4d3e-4653-b913-eb71a935ee7a tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:02.850067 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c0e52bc-4d3e-4653-b913-eb71a935ee7a tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:02.850832 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c0e52bc-4d3e-4653-b913-eb71a935ee7a tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:02.851261 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c0e52bc-4d3e-4653-b913-eb71a935ee7a tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:02.862518 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=100 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:26:02.878735 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4be959e3-7c5e-4610-bc33-5ec84f9c7cf3 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:02.889006 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4be959e3-7c5e-4610-bc33-5ec84f9c7cf3 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1315 microversion: 2.1 time: 0.192130 May 28 17:26:02.895204 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 40/90] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:02 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:03.032535 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1c0e52bc-4d3e-4653-b913-eb71a935ee7a tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:03.041898 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1c0e52bc-4d3e-4653-b913-eb71a935ee7a tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1363 microversion: 2.1 time: 0.210533 May 28 17:26:03.043240 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 51/91] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:02 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:03.327811 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-e236e3b4-68a4-4af5-99f0-ab0df2d32003 req-4c42c21b-7533-4c93-b772-d568d04dd1ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3425b63d-c751-49bf-b2d9-0568c8cdae34", "name": "network-vif-plugged", "status": "completed", "tag": "484051b7-f005-48d0-a799-a12b167c29db"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:26:03.336390 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-e236e3b4-68a4-4af5-99f0-ab0df2d32003 req-4c42c21b-7533-4c93-b772-d568d04dd1ea service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:03.336985 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-e236e3b4-68a4-4af5-99f0-ab0df2d32003 req-4c42c21b-7533-4c93-b772-d568d04dd1ea service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:03.352672 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-e236e3b4-68a4-4af5-99f0-ab0df2d32003 req-4c42c21b-7533-4c93-b772-d568d04dd1ea service nova] Creating event network-vif-plugged:484051b7-f005-48d0-a799-a12b167c29db for instance 3425b63d-c751-49bf-b2d9-0568c8cdae34 on hv-cinder-84372 May 28 17:26:03.358455 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-e236e3b4-68a4-4af5-99f0-ab0df2d32003 req-4c42c21b-7533-4c93-b772-d568d04dd1ea service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.273481 May 28 17:26:03.363059 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 41/92] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:26:03.814631 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6519544a-786b-478d-8f3d-aec50a0409ac tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:03.815327 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6519544a-786b-478d-8f3d-aec50a0409ac tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:03.825561 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6519544a-786b-478d-8f3d-aec50a0409ac tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:03.826085 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6519544a-786b-478d-8f3d-aec50a0409ac tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:03.827471 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6519544a-786b-478d-8f3d-aec50a0409ac tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:03.829426 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6519544a-786b-478d-8f3d-aec50a0409ac tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:03.912566 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4e9e035e-6a99-461f-9d59-9b09e725ebe7 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:03.914123 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4e9e035e-6a99-461f-9d59-9b09e725ebe7 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:03.927412 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4e9e035e-6a99-461f-9d59-9b09e725ebe7 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:03.928092 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4e9e035e-6a99-461f-9d59-9b09e725ebe7 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:03.929748 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4e9e035e-6a99-461f-9d59-9b09e725ebe7 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:03.930185 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4e9e035e-6a99-461f-9d59-9b09e725ebe7 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:03.978092 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6519544a-786b-478d-8f3d-aec50a0409ac tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:03.986606 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6519544a-786b-478d-8f3d-aec50a0409ac tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.176167 May 28 17:26:03.987616 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 52/93] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:03 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:04.059965 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-abeba9e9-0076-4d8c-b726-220e87686ee0 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:04.060737 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-abeba9e9-0076-4d8c-b726-220e87686ee0 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:04.068895 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-abeba9e9-0076-4d8c-b726-220e87686ee0 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:04.069980 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-abeba9e9-0076-4d8c-b726-220e87686ee0 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:04.071170 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-abeba9e9-0076-4d8c-b726-220e87686ee0 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:04.072581 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-abeba9e9-0076-4d8c-b726-220e87686ee0 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:04.095671 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4e9e035e-6a99-461f-9d59-9b09e725ebe7 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:04.104369 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4e9e035e-6a99-461f-9d59-9b09e725ebe7 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1315 microversion: 2.1 time: 0.198459 May 28 17:26:04.114714 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 42/94] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:03 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:04.309574 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-abeba9e9-0076-4d8c-b726-220e87686ee0 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:04.317839 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-abeba9e9-0076-4d8c-b726-220e87686ee0 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1363 microversion: 2.1 time: 0.262547 May 28 17:26:04.318947 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 53/95] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:04 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:05.009125 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ef22b7a6-85b2-405f-ac14-8ddfc341650d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:05.011497 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ef22b7a6-85b2-405f-ac14-8ddfc341650d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:05.019521 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ef22b7a6-85b2-405f-ac14-8ddfc341650d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:05.020248 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ef22b7a6-85b2-405f-ac14-8ddfc341650d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:05.021419 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ef22b7a6-85b2-405f-ac14-8ddfc341650d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:05.022604 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ef22b7a6-85b2-405f-ac14-8ddfc341650d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:05.121794 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-333b213f-6076-43ef-90e8-b78770b87821 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:05.123111 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-333b213f-6076-43ef-90e8-b78770b87821 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:05.129382 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-333b213f-6076-43ef-90e8-b78770b87821 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:05.129928 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-333b213f-6076-43ef-90e8-b78770b87821 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:05.130756 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-333b213f-6076-43ef-90e8-b78770b87821 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:05.131260 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-333b213f-6076-43ef-90e8-b78770b87821 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:05.271933 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ef22b7a6-85b2-405f-ac14-8ddfc341650d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:05.284632 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ef22b7a6-85b2-405f-ac14-8ddfc341650d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.283834 May 28 17:26:05.288192 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 43/96] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:04 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:05.320616 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-333b213f-6076-43ef-90e8-b78770b87821 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:05.331374 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-333b213f-6076-43ef-90e8-b78770b87821 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1315 microversion: 2.1 time: 0.213485 May 28 17:26:05.336213 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c9f096ca-7276-4106-bd26-4f23c731cd89 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:05.337856 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c9f096ca-7276-4106-bd26-4f23c731cd89 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:05.350020 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 54/97] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:05 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:05.353455 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c9f096ca-7276-4106-bd26-4f23c731cd89 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:05.354788 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c9f096ca-7276-4106-bd26-4f23c731cd89 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:05.371714 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c9f096ca-7276-4106-bd26-4f23c731cd89 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:05.372350 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c9f096ca-7276-4106-bd26-4f23c731cd89 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:05.563554 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c9f096ca-7276-4106-bd26-4f23c731cd89 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:05.572118 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c9f096ca-7276-4106-bd26-4f23c731cd89 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1363 microversion: 2.1 time: 0.240095 May 28 17:26:05.573371 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 44/98] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:05 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:06.306519 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f9052b56-9f1b-4cd7-9203-d7ffef1f6e09 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:06.309332 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f9052b56-9f1b-4cd7-9203-d7ffef1f6e09 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:06.313150 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:26:06.323764 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f9052b56-9f1b-4cd7-9203-d7ffef1f6e09 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:06.325043 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f9052b56-9f1b-4cd7-9203-d7ffef1f6e09 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:06.326227 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f9052b56-9f1b-4cd7-9203-d7ffef1f6e09 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:06.326964 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f9052b56-9f1b-4cd7-9203-d7ffef1f6e09 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:06.350088 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-80c8d38f-5b8f-4889-b364-63947e18d585 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:06.351452 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-80c8d38f-5b8f-4889-b364-63947e18d585 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:06.360716 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-80c8d38f-5b8f-4889-b364-63947e18d585 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:06.362265 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-80c8d38f-5b8f-4889-b364-63947e18d585 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:06.363641 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-80c8d38f-5b8f-4889-b364-63947e18d585 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:06.364460 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-80c8d38f-5b8f-4889-b364-63947e18d585 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:06.568616 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f9052b56-9f1b-4cd7-9203-d7ffef1f6e09 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:06.584989 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f9052b56-9f1b-4cd7-9203-d7ffef1f6e09 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.280972 May 28 17:26:06.586620 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 55/99] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:06 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:06.601500 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-80c8d38f-5b8f-4889-b364-63947e18d585 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:06.609077 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-451f5f9b-5ef3-4e0a-8fd0-4347150073bd tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:06.611255 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-451f5f9b-5ef3-4e0a-8fd0-4347150073bd tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:06.626123 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-80c8d38f-5b8f-4889-b364-63947e18d585 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1315 microversion: 2.1 time: 0.279152 May 28 17:26:06.627778 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-451f5f9b-5ef3-4e0a-8fd0-4347150073bd tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:06.628126 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 45/100] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:06 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:06.628262 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-451f5f9b-5ef3-4e0a-8fd0-4347150073bd tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:06.629676 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-451f5f9b-5ef3-4e0a-8fd0-4347150073bd tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:06.630130 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-451f5f9b-5ef3-4e0a-8fd0-4347150073bd tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:06.880613 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-451f5f9b-5ef3-4e0a-8fd0-4347150073bd tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:06.890615 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-451f5f9b-5ef3-4e0a-8fd0-4347150073bd tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1363 microversion: 2.1 time: 0.300691 May 28 17:26:06.891405 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 56/101] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:06 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1363 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:07.606172 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-61c59470-5107-4e4a-ba89-fb151f5de216 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:07.607720 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-61c59470-5107-4e4a-ba89-fb151f5de216 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:07.616166 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-61c59470-5107-4e4a-ba89-fb151f5de216 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:07.616883 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-61c59470-5107-4e4a-ba89-fb151f5de216 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:07.617930 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-61c59470-5107-4e4a-ba89-fb151f5de216 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:07.618509 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-61c59470-5107-4e4a-ba89-fb151f5de216 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:07.646564 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-20f01772-e84e-4965-95e2-64cf9e4325a1 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:07.648015 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-20f01772-e84e-4965-95e2-64cf9e4325a1 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:07.656599 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-20f01772-e84e-4965-95e2-64cf9e4325a1 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:07.657279 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-20f01772-e84e-4965-95e2-64cf9e4325a1 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:07.658964 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-20f01772-e84e-4965-95e2-64cf9e4325a1 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:07.659440 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-20f01772-e84e-4965-95e2-64cf9e4325a1 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:08.145464 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-61c59470-5107-4e4a-ba89-fb151f5de216 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:08.156346 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-61c59470-5107-4e4a-ba89-fb151f5de216 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.558068 May 28 17:26:08.158247 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 46/102] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:07 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:08.166093 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-241c40ab-bfee-461d-9868-a91f380fe6a7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:08.167647 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-241c40ab-bfee-461d-9868-a91f380fe6a7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:08.173557 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-20f01772-e84e-4965-95e2-64cf9e4325a1 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:08.184281 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-241c40ab-bfee-461d-9868-a91f380fe6a7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:08.186702 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-241c40ab-bfee-461d-9868-a91f380fe6a7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:08.188487 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-241c40ab-bfee-461d-9868-a91f380fe6a7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:08.188624 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-20f01772-e84e-4965-95e2-64cf9e4325a1 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1315 microversion: 2.1 time: 0.547124 May 28 17:26:08.189398 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 57/103] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:07 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1315 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:08.190998 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-241c40ab-bfee-461d-9868-a91f380fe6a7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:08.194377 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-616d331d-b6a8-461b-9378-4323c79b1ec4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1351125545", "imageRef": "b2aab55c-a793-472a-bc32-81af689ad609", "flavorRef": "452", "networks": [{"uuid": "64d9df32-417a-4110-9ebe-97bfa607c330"}]}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:26:08.290645 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.network.neutron [None req-616d331d-b6a8-461b-9378-4323c79b1ec4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] validate_networks() for [('64d9df32-417a-4110-9ebe-97bfa607c330', None, None, None, None, None)] {{(pid=117604) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 17:26:08.587001 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-241c40ab-bfee-461d-9868-a91f380fe6a7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:08.594930 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-241c40ab-bfee-461d-9868-a91f380fe6a7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1363 microversion: 2.1 time: 0.435397 May 28 17:26:08.595537 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 47/104] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:08 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1363 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:08.646948 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-07925055-1d11-47fa-a91d-12abf52779a9 req-13a32043-2a35-4947-bd90-33547dbdd017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3b0710-2e45-41e0-b02a-a9b95245f62a", "name": "network-vif-plugged", "status": "completed", "tag": "4e39dc15-aca5-489f-886d-23cd2b05b64d"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:26:08.665507 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-07925055-1d11-47fa-a91d-12abf52779a9 req-13a32043-2a35-4947-bd90-33547dbdd017 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:08.666099 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-07925055-1d11-47fa-a91d-12abf52779a9 req-13a32043-2a35-4947-bd90-33547dbdd017 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:08.687302 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-07925055-1d11-47fa-a91d-12abf52779a9 req-13a32043-2a35-4947-bd90-33547dbdd017 service nova] Creating event network-vif-plugged:4e39dc15-aca5-489f-886d-23cd2b05b64d for instance 1c3b0710-2e45-41e0-b02a-a9b95245f62a on hv-cinder-84372 May 28 17:26:08.701246 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-07925055-1d11-47fa-a91d-12abf52779a9 req-13a32043-2a35-4947-bd90-33547dbdd017 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059642 May 28 17:26:08.702298 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 48/105] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:26:09.071361 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-616d331d-b6a8-461b-9378-4323c79b1ec4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Flavor limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 17:26:09.071863 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-616d331d-b6a8-461b-9378-4323c79b1ec4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Image limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 17:26:09.072415 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-616d331d-b6a8-461b-9378-4323c79b1ec4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Flavor pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 17:26:09.072822 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-616d331d-b6a8-461b-9378-4323c79b1ec4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Image pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 17:26:09.073241 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-616d331d-b6a8-461b-9378-4323c79b1ec4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 17:26:09.081873 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-616d331d-b6a8-461b-9378-4323c79b1ec4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:09.082580 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-616d331d-b6a8-461b-9378-4323c79b1ec4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:09.083600 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-616d331d-b6a8-461b-9378-4323c79b1ec4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:09.084170 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-616d331d-b6a8-461b-9378-4323c79b1ec4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:09.101959 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-616d331d-b6a8-461b-9378-4323c79b1ec4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Getting quotas for project dd6efc6e9dad4ab1b9c40ab78d5a360d. Resources: {'instances', 'cores', 'ram'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:26:09.107233 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-616d331d-b6a8-461b-9378-4323c79b1ec4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Getting quotas for user b6a6d8ab7cc04e14b8f148412974e995 and project dd6efc6e9dad4ab1b9c40ab78d5a360d. Resources: {'instances', 'cores', 'ram'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:26:09.118673 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-616d331d-b6a8-461b-9378-4323c79b1ec4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Going to run 1 instances... {{(pid=117604) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 17:26:09.121843 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-616d331d-b6a8-461b-9378-4323c79b1ec4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b2aab55c-a793-472a-bc32-81af689ad609',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 17:26:09.172808 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-616d331d-b6a8-461b-9378-4323c79b1ec4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.982124 May 28 17:26:09.173644 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 58/106] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 17:26:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 17:26:09.174801 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-943272f5-af8b-4b12-8c4b-600b72ac49d3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:09.175540 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-943272f5-af8b-4b12-8c4b-600b72ac49d3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:09.182448 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-943272f5-af8b-4b12-8c4b-600b72ac49d3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:09.183224 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-943272f5-af8b-4b12-8c4b-600b72ac49d3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:09.184390 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-943272f5-af8b-4b12-8c4b-600b72ac49d3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:09.185021 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-943272f5-af8b-4b12-8c4b-600b72ac49d3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:09.187268 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6bf38344-e7b5-426d-ad53-aedfa1c43fe3 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:09.187920 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6bf38344-e7b5-426d-ad53-aedfa1c43fe3 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:09.264858 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6bf38344-e7b5-426d-ad53-aedfa1c43fe3 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:09.271463 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6bf38344-e7b5-426d-ad53-aedfa1c43fe3 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1219 microversion: 2.1 time: 0.088769 May 28 17:26:09.272026 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 59/107] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:09 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:09.287217 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d34deac6-d9c4-4435-9e75-14242ee04e8f tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:09.288072 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d34deac6-d9c4-4435-9e75-14242ee04e8f tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:09.296108 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d34deac6-d9c4-4435-9e75-14242ee04e8f tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:09.296921 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d34deac6-d9c4-4435-9e75-14242ee04e8f tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:09.297895 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d34deac6-d9c4-4435-9e75-14242ee04e8f tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:09.298496 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d34deac6-d9c4-4435-9e75-14242ee04e8f tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:09.411952 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-943272f5-af8b-4b12-8c4b-600b72ac49d3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:09.449488 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-943272f5-af8b-4b12-8c4b-600b72ac49d3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.279017 May 28 17:26:09.451939 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 49/108] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:09 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:09.478578 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d34deac6-d9c4-4435-9e75-14242ee04e8f tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:09.490882 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d34deac6-d9c4-4435-9e75-14242ee04e8f tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1315 microversion: 2.1 time: 0.217098 May 28 17:26:09.491670 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 60/109] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:09 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:09.611855 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ef2c0fc5-ac51-49f3-aa69-40652a727679 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:09.612460 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ef2c0fc5-ac51-49f3-aa69-40652a727679 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:09.619321 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ef2c0fc5-ac51-49f3-aa69-40652a727679 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:09.620107 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ef2c0fc5-ac51-49f3-aa69-40652a727679 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:09.621064 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ef2c0fc5-ac51-49f3-aa69-40652a727679 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:09.621569 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ef2c0fc5-ac51-49f3-aa69-40652a727679 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:09.755616 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ef2c0fc5-ac51-49f3-aa69-40652a727679 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:09.763847 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ef2c0fc5-ac51-49f3-aa69-40652a727679 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1363 microversion: 2.1 time: 0.156193 May 28 17:26:09.764423 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 50/110] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:09 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:10.289299 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a1059cee-5e44-4525-b34f-1173a2f35ccc tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:10.289897 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a1059cee-5e44-4525-b34f-1173a2f35ccc tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:10.297000 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a1059cee-5e44-4525-b34f-1173a2f35ccc tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:10.297725 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a1059cee-5e44-4525-b34f-1173a2f35ccc tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:10.298766 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a1059cee-5e44-4525-b34f-1173a2f35ccc tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:10.299410 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a1059cee-5e44-4525-b34f-1173a2f35ccc tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:10.374421 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a1059cee-5e44-4525-b34f-1173a2f35ccc tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:10.382976 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a1059cee-5e44-4525-b34f-1173a2f35ccc tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1223 microversion: 2.1 time: 0.097630 May 28 17:26:10.383811 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 61/111] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:10 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1223 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:10.468254 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ac341fdc-1601-4b8a-92e9-21e304e6a252 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:10.469414 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ac341fdc-1601-4b8a-92e9-21e304e6a252 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:10.476281 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ac341fdc-1601-4b8a-92e9-21e304e6a252 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:10.476781 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ac341fdc-1601-4b8a-92e9-21e304e6a252 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:10.477853 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ac341fdc-1601-4b8a-92e9-21e304e6a252 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:10.482699 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ac341fdc-1601-4b8a-92e9-21e304e6a252 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:10.508206 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ddf35005-aabb-4073-9bce-3786a45b7783 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:10.508810 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ddf35005-aabb-4073-9bce-3786a45b7783 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:10.521193 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ddf35005-aabb-4073-9bce-3786a45b7783 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:10.522964 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ddf35005-aabb-4073-9bce-3786a45b7783 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:10.524121 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ddf35005-aabb-4073-9bce-3786a45b7783 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:10.525583 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ddf35005-aabb-4073-9bce-3786a45b7783 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:10.638195 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ac341fdc-1601-4b8a-92e9-21e304e6a252 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:10.650920 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ac341fdc-1601-4b8a-92e9-21e304e6a252 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.186386 May 28 17:26:10.651840 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 51/112] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:10 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:10.717073 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ddf35005-aabb-4073-9bce-3786a45b7783 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:10.725111 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ddf35005-aabb-4073-9bce-3786a45b7783 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1315 microversion: 2.1 time: 0.220568 May 28 17:26:10.725616 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 62/113] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:10 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:10.781403 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0fdc5995-9778-4c15-add4-af3da6288ceb tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:10.782024 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0fdc5995-9778-4c15-add4-af3da6288ceb tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:10.788268 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0fdc5995-9778-4c15-add4-af3da6288ceb tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:10.788934 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0fdc5995-9778-4c15-add4-af3da6288ceb tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:10.789700 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0fdc5995-9778-4c15-add4-af3da6288ceb tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:10.790311 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0fdc5995-9778-4c15-add4-af3da6288ceb tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:10.795322 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=100 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:26:10.932579 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0fdc5995-9778-4c15-add4-af3da6288ceb tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:10.943633 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0fdc5995-9778-4c15-add4-af3da6288ceb tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1363 microversion: 2.1 time: 0.165874 May 28 17:26:10.944540 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 52/114] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:10 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:11.402036 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c68c680d-7c62-4cc5-a754-3449dee9620b tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:11.403355 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c68c680d-7c62-4cc5-a754-3449dee9620b tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:11.409643 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c68c680d-7c62-4cc5-a754-3449dee9620b tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:11.410273 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c68c680d-7c62-4cc5-a754-3449dee9620b tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:11.411042 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c68c680d-7c62-4cc5-a754-3449dee9620b tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:11.411628 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c68c680d-7c62-4cc5-a754-3449dee9620b tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:11.480394 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c68c680d-7c62-4cc5-a754-3449dee9620b tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:11.492328 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c68c680d-7c62-4cc5-a754-3449dee9620b tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1223 microversion: 2.1 time: 0.095730 May 28 17:26:11.493610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 63/115] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:11 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:11.668456 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-25c3bfeb-64eb-494d-9153-90cab95f00d6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:11.669351 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-25c3bfeb-64eb-494d-9153-90cab95f00d6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:11.676488 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-25c3bfeb-64eb-494d-9153-90cab95f00d6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:11.677168 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-25c3bfeb-64eb-494d-9153-90cab95f00d6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:11.678117 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-25c3bfeb-64eb-494d-9153-90cab95f00d6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:11.678760 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-25c3bfeb-64eb-494d-9153-90cab95f00d6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:11.742939 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-69eeb3df-e115-4d93-af30-995bc7c31289 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:11.743909 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-69eeb3df-e115-4d93-af30-995bc7c31289 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:11.751620 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-69eeb3df-e115-4d93-af30-995bc7c31289 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:11.752716 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-69eeb3df-e115-4d93-af30-995bc7c31289 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:11.753849 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-69eeb3df-e115-4d93-af30-995bc7c31289 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:11.754748 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-69eeb3df-e115-4d93-af30-995bc7c31289 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:11.858164 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-25c3bfeb-64eb-494d-9153-90cab95f00d6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:11.866439 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-25c3bfeb-64eb-494d-9153-90cab95f00d6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.202774 May 28 17:26:11.867208 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 53/116] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:11 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:11.952468 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-69eeb3df-e115-4d93-af30-995bc7c31289 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:11.960145 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-69eeb3df-e115-4d93-af30-995bc7c31289 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1315 microversion: 2.1 time: 0.221571 May 28 17:26:11.961315 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 64/117] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:11 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:11.966196 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f8fca35f-ba2b-4fb3-9ab9-88997578a4da tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:11.966942 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f8fca35f-ba2b-4fb3-9ab9-88997578a4da tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:11.976520 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f8fca35f-ba2b-4fb3-9ab9-88997578a4da tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:11.976992 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f8fca35f-ba2b-4fb3-9ab9-88997578a4da tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:11.977832 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f8fca35f-ba2b-4fb3-9ab9-88997578a4da tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:11.978340 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f8fca35f-ba2b-4fb3-9ab9-88997578a4da tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:12.143360 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f8fca35f-ba2b-4fb3-9ab9-88997578a4da tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:12.161698 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f8fca35f-ba2b-4fb3-9ab9-88997578a4da tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1363 microversion: 2.1 time: 0.204207 May 28 17:26:12.163167 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 54/118] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:11 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:12.514221 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-7c9e6a5a-fc10-45da-bfea-ed4785078aa3 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:12.515138 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-7c9e6a5a-fc10-45da-bfea-ed4785078aa3 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:12.521758 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7c9e6a5a-fc10-45da-bfea-ed4785078aa3 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:12.522609 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7c9e6a5a-fc10-45da-bfea-ed4785078aa3 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:12.523782 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7c9e6a5a-fc10-45da-bfea-ed4785078aa3 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:12.524319 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7c9e6a5a-fc10-45da-bfea-ed4785078aa3 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:12.594028 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7c9e6a5a-fc10-45da-bfea-ed4785078aa3 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:12.601498 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-7c9e6a5a-fc10-45da-bfea-ed4785078aa3 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1223 microversion: 2.1 time: 0.094369 May 28 17:26:12.602058 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 65/119] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:12 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:12.888423 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5aa2d444-eadf-42be-ac2e-edf9a647a6a7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:12.890128 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5aa2d444-eadf-42be-ac2e-edf9a647a6a7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:12.906485 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5aa2d444-eadf-42be-ac2e-edf9a647a6a7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:12.906951 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5aa2d444-eadf-42be-ac2e-edf9a647a6a7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:12.907804 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5aa2d444-eadf-42be-ac2e-edf9a647a6a7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:12.908241 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5aa2d444-eadf-42be-ac2e-edf9a647a6a7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:12.979750 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9176fffb-8c4f-4b1e-8fd8-b259837d3afd tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:12.980381 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9176fffb-8c4f-4b1e-8fd8-b259837d3afd tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:12.988533 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9176fffb-8c4f-4b1e-8fd8-b259837d3afd tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:12.988991 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9176fffb-8c4f-4b1e-8fd8-b259837d3afd tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:12.989891 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9176fffb-8c4f-4b1e-8fd8-b259837d3afd tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:12.991006 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9176fffb-8c4f-4b1e-8fd8-b259837d3afd tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:13.077518 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5aa2d444-eadf-42be-ac2e-edf9a647a6a7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:13.085210 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5aa2d444-eadf-42be-ac2e-edf9a647a6a7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.202164 May 28 17:26:13.087555 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 55/120] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:12 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:13.184521 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2b2dda18-c818-4008-8eb6-3f934d6bcaad tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:13.184952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9176fffb-8c4f-4b1e-8fd8-b259837d3afd tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:13.185535 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2b2dda18-c818-4008-8eb6-3f934d6bcaad tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:13.194503 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9176fffb-8c4f-4b1e-8fd8-b259837d3afd tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1315 microversion: 2.1 time: 0.220269 May 28 17:26:13.195374 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 66/121] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:12 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:13.195642 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2b2dda18-c818-4008-8eb6-3f934d6bcaad tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:13.207397 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2b2dda18-c818-4008-8eb6-3f934d6bcaad tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:13.207784 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2b2dda18-c818-4008-8eb6-3f934d6bcaad tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:13.208405 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2b2dda18-c818-4008-8eb6-3f934d6bcaad tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:13.358513 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2b2dda18-c818-4008-8eb6-3f934d6bcaad tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:13.366575 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2b2dda18-c818-4008-8eb6-3f934d6bcaad tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1363 microversion: 2.1 time: 0.188313 May 28 17:26:13.367144 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 56/122] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:13 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:13.620806 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d961be88-2cc2-4493-ad00-ec2ba7892882 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:13.621557 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d961be88-2cc2-4493-ad00-ec2ba7892882 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:13.627739 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d961be88-2cc2-4493-ad00-ec2ba7892882 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:13.628485 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d961be88-2cc2-4493-ad00-ec2ba7892882 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:13.629599 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d961be88-2cc2-4493-ad00-ec2ba7892882 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:13.630433 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d961be88-2cc2-4493-ad00-ec2ba7892882 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:13.706098 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d961be88-2cc2-4493-ad00-ec2ba7892882 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:13.730319 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d961be88-2cc2-4493-ad00-ec2ba7892882 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1223 microversion: 2.1 time: 0.113370 May 28 17:26:13.731687 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 67/123] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:13 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1223 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:14.103003 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8b4d5a9a-a150-4280-a958-bbefdce0e152 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:14.103718 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8b4d5a9a-a150-4280-a958-bbefdce0e152 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:14.110006 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8b4d5a9a-a150-4280-a958-bbefdce0e152 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:14.110481 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8b4d5a9a-a150-4280-a958-bbefdce0e152 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:14.111262 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8b4d5a9a-a150-4280-a958-bbefdce0e152 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:14.111748 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8b4d5a9a-a150-4280-a958-bbefdce0e152 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:14.213981 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-69f0c554-bde3-403f-9450-8057a64905de tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:14.215034 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-69f0c554-bde3-403f-9450-8057a64905de tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:14.221891 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-69f0c554-bde3-403f-9450-8057a64905de tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:14.222722 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-69f0c554-bde3-403f-9450-8057a64905de tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:14.223536 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-69f0c554-bde3-403f-9450-8057a64905de tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:14.224058 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-69f0c554-bde3-403f-9450-8057a64905de tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:14.295189 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8b4d5a9a-a150-4280-a958-bbefdce0e152 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:14.304959 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8b4d5a9a-a150-4280-a958-bbefdce0e152 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.206895 May 28 17:26:14.305865 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 57/124] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:14 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:14.385649 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-cb997949-49dd-4625-af20-f51d1099c72d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:14.386318 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-cb997949-49dd-4625-af20-f51d1099c72d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:14.394952 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cb997949-49dd-4625-af20-f51d1099c72d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:14.397128 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cb997949-49dd-4625-af20-f51d1099c72d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:14.402097 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cb997949-49dd-4625-af20-f51d1099c72d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:14.402740 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cb997949-49dd-4625-af20-f51d1099c72d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:14.449206 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-69f0c554-bde3-403f-9450-8057a64905de tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:14.458033 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-69f0c554-bde3-403f-9450-8057a64905de tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1315 microversion: 2.1 time: 0.248833 May 28 17:26:14.458687 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 68/125] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:14 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:14.571172 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-cb997949-49dd-4625-af20-f51d1099c72d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:14.583797 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-cb997949-49dd-4625-af20-f51d1099c72d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1363 microversion: 2.1 time: 0.202256 May 28 17:26:14.590130 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 58/126] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:14 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:14.748336 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a928ed6a-34b9-40b0-89e2-4f79ae9a6ebf tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:14.748994 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a928ed6a-34b9-40b0-89e2-4f79ae9a6ebf tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:14.755446 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a928ed6a-34b9-40b0-89e2-4f79ae9a6ebf tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:14.755898 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a928ed6a-34b9-40b0-89e2-4f79ae9a6ebf tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:14.756668 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a928ed6a-34b9-40b0-89e2-4f79ae9a6ebf tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:14.757097 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a928ed6a-34b9-40b0-89e2-4f79ae9a6ebf tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:14.806276 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=100 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:26:14.859637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a928ed6a-34b9-40b0-89e2-4f79ae9a6ebf tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:14.868206 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a928ed6a-34b9-40b0-89e2-4f79ae9a6ebf tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1223 microversion: 2.1 time: 0.125145 May 28 17:26:14.869216 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 69/127] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:14 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1223 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:15.324173 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0cce37bb-9fbd-489b-9556-5df34f44dd31 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:15.325613 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0cce37bb-9fbd-489b-9556-5df34f44dd31 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:15.332238 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0cce37bb-9fbd-489b-9556-5df34f44dd31 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:15.333207 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0cce37bb-9fbd-489b-9556-5df34f44dd31 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:15.334548 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0cce37bb-9fbd-489b-9556-5df34f44dd31 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:15.335100 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0cce37bb-9fbd-489b-9556-5df34f44dd31 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:15.475197 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-bf00797d-1be3-4634-841b-914e9ac138bb tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:15.476804 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0cce37bb-9fbd-489b-9556-5df34f44dd31 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:15.477602 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-bf00797d-1be3-4634-841b-914e9ac138bb tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:15.486978 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bf00797d-1be3-4634-841b-914e9ac138bb tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:15.487536 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bf00797d-1be3-4634-841b-914e9ac138bb tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:15.488514 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bf00797d-1be3-4634-841b-914e9ac138bb tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:15.488861 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0cce37bb-9fbd-489b-9556-5df34f44dd31 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.169976 May 28 17:26:15.489445 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 59/128] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:15 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:15.489664 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bf00797d-1be3-4634-841b-914e9ac138bb tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:15.606928 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-089f8659-1e12-4a80-b3c4-5358223b4354 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:15.607500 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-089f8659-1e12-4a80-b3c4-5358223b4354 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:15.613507 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-089f8659-1e12-4a80-b3c4-5358223b4354 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:15.613945 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-089f8659-1e12-4a80-b3c4-5358223b4354 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:15.614706 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-089f8659-1e12-4a80-b3c4-5358223b4354 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:15.615139 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-089f8659-1e12-4a80-b3c4-5358223b4354 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:15.629796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-bf00797d-1be3-4634-841b-914e9ac138bb tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:15.637908 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-bf00797d-1be3-4634-841b-914e9ac138bb tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1315 microversion: 2.1 time: 0.166660 May 28 17:26:15.638987 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 70/129] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:15 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:15.757175 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-089f8659-1e12-4a80-b3c4-5358223b4354 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:15.770510 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-089f8659-1e12-4a80-b3c4-5358223b4354 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1363 microversion: 2.1 time: 0.168563 May 28 17:26:15.781407 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 60/130] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:15 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:15.888286 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c0c3b771-f8d8-4596-a30e-6be07375b3ed tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:15.888929 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c0c3b771-f8d8-4596-a30e-6be07375b3ed tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:15.918019 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c0c3b771-f8d8-4596-a30e-6be07375b3ed tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:15.918474 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c0c3b771-f8d8-4596-a30e-6be07375b3ed tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:15.923278 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c0c3b771-f8d8-4596-a30e-6be07375b3ed tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:15.923827 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c0c3b771-f8d8-4596-a30e-6be07375b3ed tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:16.009377 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c0c3b771-f8d8-4596-a30e-6be07375b3ed tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:16.022920 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c0c3b771-f8d8-4596-a30e-6be07375b3ed tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1215 microversion: 2.1 time: 0.139104 May 28 17:26:16.024404 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 71/131] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:15 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1215 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:16.506163 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-edfa0ab0-65c0-4ade-8abc-f285c1073576 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:16.507564 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-edfa0ab0-65c0-4ade-8abc-f285c1073576 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:16.515030 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-edfa0ab0-65c0-4ade-8abc-f285c1073576 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:16.515592 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-edfa0ab0-65c0-4ade-8abc-f285c1073576 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:16.516410 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-edfa0ab0-65c0-4ade-8abc-f285c1073576 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:16.517014 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-edfa0ab0-65c0-4ade-8abc-f285c1073576 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:16.655961 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-36c3e8d3-831e-46d8-944e-7cfcc8cbb61a tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:16.656599 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-36c3e8d3-831e-46d8-944e-7cfcc8cbb61a tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:16.670858 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-36c3e8d3-831e-46d8-944e-7cfcc8cbb61a tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:16.671312 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-36c3e8d3-831e-46d8-944e-7cfcc8cbb61a tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:16.672205 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-36c3e8d3-831e-46d8-944e-7cfcc8cbb61a tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:16.672655 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-36c3e8d3-831e-46d8-944e-7cfcc8cbb61a tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:16.722506 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-edfa0ab0-65c0-4ade-8abc-f285c1073576 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:16.730922 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-edfa0ab0-65c0-4ade-8abc-f285c1073576 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.228677 May 28 17:26:16.732158 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 61/132] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:16 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:16.797534 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9e3756b8-923c-4b65-ba1a-348b8010e58d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:16.798408 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9e3756b8-923c-4b65-ba1a-348b8010e58d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:16.804397 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9e3756b8-923c-4b65-ba1a-348b8010e58d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:16.804926 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9e3756b8-923c-4b65-ba1a-348b8010e58d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:16.805756 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9e3756b8-923c-4b65-ba1a-348b8010e58d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:16.806265 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9e3756b8-923c-4b65-ba1a-348b8010e58d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:16.829239 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-36c3e8d3-831e-46d8-944e-7cfcc8cbb61a tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:16.836743 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-36c3e8d3-831e-46d8-944e-7cfcc8cbb61a tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1315 microversion: 2.1 time: 0.186528 May 28 17:26:16.837305 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 72/133] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:16 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:16.949942 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-9e3756b8-923c-4b65-ba1a-348b8010e58d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:16.957433 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9e3756b8-923c-4b65-ba1a-348b8010e58d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1363 microversion: 2.1 time: 0.163828 May 28 17:26:16.958012 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 62/134] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:16 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:17.042781 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ba6f270b-66c3-4a23-9196-162e36f07148 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:17.043597 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ba6f270b-66c3-4a23-9196-162e36f07148 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:17.051500 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ba6f270b-66c3-4a23-9196-162e36f07148 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:17.053682 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ba6f270b-66c3-4a23-9196-162e36f07148 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:17.055494 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ba6f270b-66c3-4a23-9196-162e36f07148 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:17.056060 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ba6f270b-66c3-4a23-9196-162e36f07148 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:17.177324 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ba6f270b-66c3-4a23-9196-162e36f07148 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:17.191845 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ba6f270b-66c3-4a23-9196-162e36f07148 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1271 microversion: 2.1 time: 0.152573 May 28 17:26:17.192712 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 73/135] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:17 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:17.752759 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b934e7e2-b222-4f91-8036-6fe2702f451f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:17.753574 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-b934e7e2-b222-4f91-8036-6fe2702f451f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:17.764424 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b934e7e2-b222-4f91-8036-6fe2702f451f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:17.765370 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b934e7e2-b222-4f91-8036-6fe2702f451f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:17.766918 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b934e7e2-b222-4f91-8036-6fe2702f451f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:17.768080 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b934e7e2-b222-4f91-8036-6fe2702f451f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:17.854381 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-955efd9f-2507-4840-82fe-f2d42c66d98d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:17.854991 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-955efd9f-2507-4840-82fe-f2d42c66d98d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:17.861728 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-955efd9f-2507-4840-82fe-f2d42c66d98d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:17.862168 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-955efd9f-2507-4840-82fe-f2d42c66d98d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:17.862920 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-955efd9f-2507-4840-82fe-f2d42c66d98d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:17.863371 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-955efd9f-2507-4840-82fe-f2d42c66d98d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:17.927623 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b934e7e2-b222-4f91-8036-6fe2702f451f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:17.935927 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b934e7e2-b222-4f91-8036-6fe2702f451f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.191630 May 28 17:26:17.936504 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 63/136] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:17 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:17.974387 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-aac9b2ca-2156-49bb-badc-061bfd8fab54 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:17.975151 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-aac9b2ca-2156-49bb-badc-061bfd8fab54 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:17.984350 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-aac9b2ca-2156-49bb-badc-061bfd8fab54 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:17.984958 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-aac9b2ca-2156-49bb-badc-061bfd8fab54 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:17.985913 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-aac9b2ca-2156-49bb-badc-061bfd8fab54 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:17.986359 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-aac9b2ca-2156-49bb-badc-061bfd8fab54 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:18.056704 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-955efd9f-2507-4840-82fe-f2d42c66d98d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:18.066590 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-955efd9f-2507-4840-82fe-f2d42c66d98d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1503 microversion: 2.1 time: 0.216879 May 28 17:26:18.067455 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 74/137] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:17 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1503 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:18.211197 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8ddc17f0-a8fc-48ee-ba40-1ccb6b3c3f52 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:18.211983 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8ddc17f0-a8fc-48ee-ba40-1ccb6b3c3f52 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:18.226063 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8ddc17f0-a8fc-48ee-ba40-1ccb6b3c3f52 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:18.226632 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8ddc17f0-a8fc-48ee-ba40-1ccb6b3c3f52 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:18.227629 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8ddc17f0-a8fc-48ee-ba40-1ccb6b3c3f52 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:18.228449 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8ddc17f0-a8fc-48ee-ba40-1ccb6b3c3f52 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:18.325626 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8ddc17f0-a8fc-48ee-ba40-1ccb6b3c3f52 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:18.337360 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8ddc17f0-a8fc-48ee-ba40-1ccb6b3c3f52 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1279 microversion: 2.1 time: 0.131132 May 28 17:26:18.339584 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 75/138] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:18 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1279 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:18.452635 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-aac9b2ca-2156-49bb-badc-061bfd8fab54 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:18.460080 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-aac9b2ca-2156-49bb-badc-061bfd8fab54 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1363 microversion: 2.1 time: 0.489561 May 28 17:26:18.460643 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 64/139] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:17 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1363 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:18.693045 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-00161ee9-0a21-4ef5-abbc-a04b3b000d48 req-3bd6a33a-99ca-4873-8d26-16dd0750b879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b3c1f29-31c9-4f5c-9875-fd1939062512", "name": "network-vif-plugged", "status": "completed", "tag": "d234e00a-5520-40b5-aa3f-c3a3f2a506ee"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:26:18.717871 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-00161ee9-0a21-4ef5-abbc-a04b3b000d48 req-3bd6a33a-99ca-4873-8d26-16dd0750b879 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:18.718543 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-00161ee9-0a21-4ef5-abbc-a04b3b000d48 req-3bd6a33a-99ca-4873-8d26-16dd0750b879 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:18.756857 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-00161ee9-0a21-4ef5-abbc-a04b3b000d48 req-3bd6a33a-99ca-4873-8d26-16dd0750b879 service nova] Creating event network-vif-plugged:d234e00a-5520-40b5-aa3f-c3a3f2a506ee for instance 3b3c1f29-31c9-4f5c-9875-fd1939062512 on hv-cinder-84372 May 28 17:26:18.766427 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-00161ee9-0a21-4ef5-abbc-a04b3b000d48 req-3bd6a33a-99ca-4873-8d26-16dd0750b879 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117604) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 28 17:26:18.767744 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d8886884-5174-47c6-8274-9096e9368ef9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:18.768187 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d8886884-5174-47c6-8274-9096e9368ef9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:18.772240 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d8886884-5174-47c6-8274-9096e9368ef9 None None] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:18.773052 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d8886884-5174-47c6-8274-9096e9368ef9 None None] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:18.797927 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.compute.rpcapi [None req-d8886884-5174-47c6-8274-9096e9368ef9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 28 17:26:18.799828 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d8886884-5174-47c6-8274-9096e9368ef9 None None] Releasing lock "compute-rpcapi-router" {{(pid=117604) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 28 17:26:18.848745 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d8886884-5174-47c6-8274-9096e9368ef9 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159717 May 28 17:26:18.849649 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 76/140] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:26:18.954338 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-df43d148-a876-46fe-9426-c848a1185363 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:18.954893 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-df43d148-a876-46fe-9426-c848a1185363 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:18.967009 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-df43d148-a876-46fe-9426-c848a1185363 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:18.967009 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-df43d148-a876-46fe-9426-c848a1185363 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:18.967282 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-df43d148-a876-46fe-9426-c848a1185363 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:18.967785 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-df43d148-a876-46fe-9426-c848a1185363 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:19.121485 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-df43d148-a876-46fe-9426-c848a1185363 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:19.130156 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-df43d148-a876-46fe-9426-c848a1185363 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.180203 May 28 17:26:19.131030 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 65/141] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:18 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:19.352716 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=8 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:26:19.358671 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a77cd27b-141a-4395-b378-ad6a3f23e33a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:19.359605 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a77cd27b-141a-4395-b378-ad6a3f23e33a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:19.366230 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a77cd27b-141a-4395-b378-ad6a3f23e33a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:19.366844 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a77cd27b-141a-4395-b378-ad6a3f23e33a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:19.367632 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a77cd27b-141a-4395-b378-ad6a3f23e33a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:19.368209 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a77cd27b-141a-4395-b378-ad6a3f23e33a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:19.437505 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a77cd27b-141a-4395-b378-ad6a3f23e33a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:19.446580 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a77cd27b-141a-4395-b378-ad6a3f23e33a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1279 microversion: 2.1 time: 0.094845 May 28 17:26:19.447876 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 77/142] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:19 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1279 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:19.479773 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ce9711ff-a776-457e-89d0-2cb58d594cc6 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:19.480754 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ce9711ff-a776-457e-89d0-2cb58d594cc6 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:19.488468 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ce9711ff-a776-457e-89d0-2cb58d594cc6 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:19.489233 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ce9711ff-a776-457e-89d0-2cb58d594cc6 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:19.490346 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ce9711ff-a776-457e-89d0-2cb58d594cc6 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:19.490846 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ce9711ff-a776-457e-89d0-2cb58d594cc6 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:19.656901 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ce9711ff-a776-457e-89d0-2cb58d594cc6 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:19.667471 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ce9711ff-a776-457e-89d0-2cb58d594cc6 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1363 microversion: 2.1 time: 0.191894 May 28 17:26:19.675773 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 66/143] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:19 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:19.692101 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-7797633f-390b-4d57-b0f3-ad23ca2f5aca tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b1ee24e-0f59-4454-80be-ffe1f551f682"}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:26:19.693566 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-7797633f-390b-4d57-b0f3-ad23ca2f5aca tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:19.701172 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7797633f-390b-4d57-b0f3-ad23ca2f5aca tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:19.701786 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7797633f-390b-4d57-b0f3-ad23ca2f5aca tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:19.702661 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7797633f-390b-4d57-b0f3-ad23ca2f5aca tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:19.703157 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7797633f-390b-4d57-b0f3-ad23ca2f5aca tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:20.148949 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0486ef57-e188-48a9-9eb2-343173afe120 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:20.150900 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0486ef57-e188-48a9-9eb2-343173afe120 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:20.158834 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0486ef57-e188-48a9-9eb2-343173afe120 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:20.159561 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0486ef57-e188-48a9-9eb2-343173afe120 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:20.160972 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0486ef57-e188-48a9-9eb2-343173afe120 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:20.161647 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0486ef57-e188-48a9-9eb2-343173afe120 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:20.344268 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0486ef57-e188-48a9-9eb2-343173afe120 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:20.358361 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0486ef57-e188-48a9-9eb2-343173afe120 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.214325 May 28 17:26:20.359972 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 67/144] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:20 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:20.466338 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6e2b3ea8-2b99-4bdb-8d9b-5e33281428fe tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:20.466970 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6e2b3ea8-2b99-4bdb-8d9b-5e33281428fe tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:20.473215 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6e2b3ea8-2b99-4bdb-8d9b-5e33281428fe tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:20.474040 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6e2b3ea8-2b99-4bdb-8d9b-5e33281428fe tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:20.474957 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6e2b3ea8-2b99-4bdb-8d9b-5e33281428fe tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:20.475456 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6e2b3ea8-2b99-4bdb-8d9b-5e33281428fe tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:20.546986 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-6e2b3ea8-2b99-4bdb-8d9b-5e33281428fe tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:20.550369 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=100 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:26:20.557288 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6e2b3ea8-2b99-4bdb-8d9b-5e33281428fe tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1279 microversion: 2.1 time: 0.097329 May 28 17:26:20.557865 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 68/145] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:20 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1279 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:20.685697 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0332ecc1-b28d-4579-b157-7d8b93bef933 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:20.686319 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0332ecc1-b28d-4579-b157-7d8b93bef933 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:20.693091 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0332ecc1-b28d-4579-b157-7d8b93bef933 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:20.693740 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0332ecc1-b28d-4579-b157-7d8b93bef933 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:20.694521 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0332ecc1-b28d-4579-b157-7d8b93bef933 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:20.694982 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0332ecc1-b28d-4579-b157-7d8b93bef933 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:20.876424 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0332ecc1-b28d-4579-b157-7d8b93bef933 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:20.886840 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0332ecc1-b28d-4579-b157-7d8b93bef933 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1363 microversion: 2.1 time: 0.206340 May 28 17:26:20.887722 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 69/146] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:20 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:21.382268 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-bd866175-d15d-4d87-85cb-af1b94406278 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:21.383732 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-bd866175-d15d-4d87-85cb-af1b94406278 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:21.394578 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bd866175-d15d-4d87-85cb-af1b94406278 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:21.395816 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bd866175-d15d-4d87-85cb-af1b94406278 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:21.402101 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bd866175-d15d-4d87-85cb-af1b94406278 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:21.403728 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bd866175-d15d-4d87-85cb-af1b94406278 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:21.584226 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-7797633f-390b-4d57-b0f3-ad23ca2f5aca tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "POST /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.896023 May 28 17:26:21.586257 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 78/147] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 17:26:19 2022] POST /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34/os-volume_attachments => generated 194 bytes in 1900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:26:21.598919 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-eb3e8f22-c52b-4270-8713-1ac60c31919e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:21.600545 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-eb3e8f22-c52b-4270-8713-1ac60c31919e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:21.612893 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-eb3e8f22-c52b-4270-8713-1ac60c31919e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:21.613612 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-eb3e8f22-c52b-4270-8713-1ac60c31919e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:21.614956 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-eb3e8f22-c52b-4270-8713-1ac60c31919e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:21.615888 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-eb3e8f22-c52b-4270-8713-1ac60c31919e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:21.728669 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-eb3e8f22-c52b-4270-8713-1ac60c31919e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:21.739789 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-eb3e8f22-c52b-4270-8713-1ac60c31919e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1277 microversion: 2.1 time: 0.149503 May 28 17:26:21.741943 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 79/148] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:21 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1277 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:21.804743 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bd866175-d15d-4d87-85cb-af1b94406278 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:21.815532 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-bd866175-d15d-4d87-85cb-af1b94406278 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.439522 May 28 17:26:21.815957 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 70/149] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:21 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:21.904615 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c5ead524-1ca7-448b-a23b-35e4876f36c7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:21.905439 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c5ead524-1ca7-448b-a23b-35e4876f36c7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:21.918932 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c5ead524-1ca7-448b-a23b-35e4876f36c7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:21.919601 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c5ead524-1ca7-448b-a23b-35e4876f36c7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:21.920529 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c5ead524-1ca7-448b-a23b-35e4876f36c7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:21.921121 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c5ead524-1ca7-448b-a23b-35e4876f36c7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:22.203597 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c5ead524-1ca7-448b-a23b-35e4876f36c7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:22.212457 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c5ead524-1ca7-448b-a23b-35e4876f36c7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1363 microversion: 2.1 time: 0.311313 May 28 17:26:22.221874 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 80/150] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:21 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1363 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:22.761668 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1b79524f-37d2-4311-8f85-b1b35d414956 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:22.762945 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1b79524f-37d2-4311-8f85-b1b35d414956 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:22.784976 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1b79524f-37d2-4311-8f85-b1b35d414956 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:22.785699 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1b79524f-37d2-4311-8f85-b1b35d414956 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:22.786708 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1b79524f-37d2-4311-8f85-b1b35d414956 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:22.787980 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1b79524f-37d2-4311-8f85-b1b35d414956 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:22.832531 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-7e2db1cf-f085-4fca-b25d-f9f40f3a80e2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:22.833143 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-7e2db1cf-f085-4fca-b25d-f9f40f3a80e2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:22.840983 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7e2db1cf-f085-4fca-b25d-f9f40f3a80e2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:22.841437 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7e2db1cf-f085-4fca-b25d-f9f40f3a80e2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:22.842206 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7e2db1cf-f085-4fca-b25d-f9f40f3a80e2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:22.842646 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7e2db1cf-f085-4fca-b25d-f9f40f3a80e2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:23.031938 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7e2db1cf-f085-4fca-b25d-f9f40f3a80e2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:23.049460 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-7e2db1cf-f085-4fca-b25d-f9f40f3a80e2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.220530 May 28 17:26:23.050521 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 81/151] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:22 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:23.082749 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1b79524f-37d2-4311-8f85-b1b35d414956 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:23.094645 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1b79524f-37d2-4311-8f85-b1b35d414956 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1319 microversion: 2.1 time: 0.336480 May 28 17:26:23.095426 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 71/152] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:22 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1319 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:23.231078 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-975ea564-ab36-4dc3-9904-3090c0d356e0 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:23.231585 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-975ea564-ab36-4dc3-9904-3090c0d356e0 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:23.243817 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-975ea564-ab36-4dc3-9904-3090c0d356e0 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:23.244584 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-975ea564-ab36-4dc3-9904-3090c0d356e0 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:23.245805 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-975ea564-ab36-4dc3-9904-3090c0d356e0 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:23.246448 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-975ea564-ab36-4dc3-9904-3090c0d356e0 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:23.640150 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-0efb4dd9-4232-4726-a16e-1b7fd158a254 req-f85dc014-8460-4628-a44f-464efdcb2065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e99fbe7a-b9c4-4f37-a515-9e598de8b512", "tag": "0bfab207-935d-43ec-8b14-0efcb1026c51"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:26:23.655837 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-0efb4dd9-4232-4726-a16e-1b7fd158a254 req-f85dc014-8460-4628-a44f-464efdcb2065 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:23.656357 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-0efb4dd9-4232-4726-a16e-1b7fd158a254 req-f85dc014-8460-4628-a44f-464efdcb2065 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:23.675412 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-0efb4dd9-4232-4726-a16e-1b7fd158a254 req-f85dc014-8460-4628-a44f-464efdcb2065 service nova] Creating event network-changed:0bfab207-935d-43ec-8b14-0efcb1026c51 for instance e99fbe7a-b9c4-4f37-a515-9e598de8b512 on hv-cinder-84372 May 28 17:26:23.676360 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-975ea564-ab36-4dc3-9904-3090c0d356e0 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:23.682850 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-0efb4dd9-4232-4726-a16e-1b7fd158a254 req-f85dc014-8460-4628-a44f-464efdcb2065 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044774 May 28 17:26:23.688067 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 72/153] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:26:23.690666 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-975ea564-ab36-4dc3-9904-3090c0d356e0 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1363 microversion: 2.1 time: 0.465626 May 28 17:26:23.693380 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 82/154] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:23 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1363 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:24.068278 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-13e0b92c-ae83-4c25-a345-c3d120e8cbdf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:24.068991 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-13e0b92c-ae83-4c25-a345-c3d120e8cbdf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:24.078000 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-13e0b92c-ae83-4c25-a345-c3d120e8cbdf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:24.082273 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-13e0b92c-ae83-4c25-a345-c3d120e8cbdf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:24.083148 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-13e0b92c-ae83-4c25-a345-c3d120e8cbdf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:24.085800 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-13e0b92c-ae83-4c25-a345-c3d120e8cbdf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:24.113931 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-de73b213-e8a8-4711-a729-a6c68fb66ec2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:24.115333 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-de73b213-e8a8-4711-a729-a6c68fb66ec2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:24.127711 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-de73b213-e8a8-4711-a729-a6c68fb66ec2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:24.128559 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-de73b213-e8a8-4711-a729-a6c68fb66ec2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:24.129521 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-de73b213-e8a8-4711-a729-a6c68fb66ec2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:24.129966 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-de73b213-e8a8-4711-a729-a6c68fb66ec2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:24.311551 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-de73b213-e8a8-4711-a729-a6c68fb66ec2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:24.319542 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-de73b213-e8a8-4711-a729-a6c68fb66ec2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1319 microversion: 2.1 time: 0.210699 May 28 17:26:24.320262 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 83/155] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:24 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:24.328274 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-13e0b92c-ae83-4c25-a345-c3d120e8cbdf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:24.335623 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-13e0b92c-ae83-4c25-a345-c3d120e8cbdf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.271827 May 28 17:26:24.336185 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 73/156] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:24 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:24.563383 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-9889578b-915f-425c-bd34-9846432dacbd req-0deb7cd4-d490-41d8-a3fd-aedc77d23beb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d6203f1-8344-4493-9b94-22fb56f73a96", "name": "network-vif-plugged", "status": "completed", "tag": "047a6d17-d6d2-4e8d-afee-99011f7fd562"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:26:24.572002 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-9889578b-915f-425c-bd34-9846432dacbd req-0deb7cd4-d490-41d8-a3fd-aedc77d23beb service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:24.573110 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-9889578b-915f-425c-bd34-9846432dacbd req-0deb7cd4-d490-41d8-a3fd-aedc77d23beb service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:24.585807 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-9889578b-915f-425c-bd34-9846432dacbd req-0deb7cd4-d490-41d8-a3fd-aedc77d23beb service nova] Creating event network-vif-plugged:047a6d17-d6d2-4e8d-afee-99011f7fd562 for instance 9d6203f1-8344-4493-9b94-22fb56f73a96 on hv-cinder-84372 May 28 17:26:24.594558 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-9889578b-915f-425c-bd34-9846432dacbd req-0deb7cd4-d490-41d8-a3fd-aedc77d23beb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034153 May 28 17:26:24.595251 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 84/157] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:26:24.709135 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-02ae4b83-52f0-44d7-81d2-848356b56aa9 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:24.709752 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-02ae4b83-52f0-44d7-81d2-848356b56aa9 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:24.716468 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-02ae4b83-52f0-44d7-81d2-848356b56aa9 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:24.716928 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-02ae4b83-52f0-44d7-81d2-848356b56aa9 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:24.717686 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-02ae4b83-52f0-44d7-81d2-848356b56aa9 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:24.718123 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-02ae4b83-52f0-44d7-81d2-848356b56aa9 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:24.855589 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-02ae4b83-52f0-44d7-81d2-848356b56aa9 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:24.863559 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-02ae4b83-52f0-44d7-81d2-848356b56aa9 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1548 microversion: 2.1 time: 0.158160 May 28 17:26:24.864195 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 74/158] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:24 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:24.881888 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2242b531-b9d4-4b59-90f0-02b536389c1f tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:24.882453 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2242b531-b9d4-4b59-90f0-02b536389c1f tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:24.890090 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2242b531-b9d4-4b59-90f0-02b536389c1f tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:24.891298 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2242b531-b9d4-4b59-90f0-02b536389c1f tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:24.892342 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2242b531-b9d4-4b59-90f0-02b536389c1f tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:24.892870 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2242b531-b9d4-4b59-90f0-02b536389c1f tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:24.988592 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2242b531-b9d4-4b59-90f0-02b536389c1f tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110876 May 28 17:26:24.990595 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 85/159] 10.222.0.33 () {58 vars in 1274 bytes} [Sat May 28 17:26:24 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:26:25.336569 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-58ba90e3-3c4d-4f7e-b369-12228a0a8088 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:25.337189 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-58ba90e3-3c4d-4f7e-b369-12228a0a8088 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:25.344415 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-58ba90e3-3c4d-4f7e-b369-12228a0a8088 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:25.344854 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-58ba90e3-3c4d-4f7e-b369-12228a0a8088 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:25.345613 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-58ba90e3-3c4d-4f7e-b369-12228a0a8088 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:25.346044 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-58ba90e3-3c4d-4f7e-b369-12228a0a8088 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:25.353112 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d4b611b9-6656-436f-af26-6f50feec5f47 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:25.354361 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d4b611b9-6656-436f-af26-6f50feec5f47 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:25.360376 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d4b611b9-6656-436f-af26-6f50feec5f47 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:25.360828 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d4b611b9-6656-436f-af26-6f50feec5f47 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:25.361587 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d4b611b9-6656-436f-af26-6f50feec5f47 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:25.362021 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d4b611b9-6656-436f-af26-6f50feec5f47 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:25.366319 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:26:25.514663 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-58ba90e3-3c4d-4f7e-b369-12228a0a8088 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:25.523886 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-58ba90e3-3c4d-4f7e-b369-12228a0a8088 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1319 microversion: 2.1 time: 0.189938 May 28 17:26:25.526397 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 75/160] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:25 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:25.636304 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d4b611b9-6656-436f-af26-6f50feec5f47 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:25.648994 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d4b611b9-6656-436f-af26-6f50feec5f47 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.299941 May 28 17:26:25.649794 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 86/161] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:25 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:26.522886 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-be913263-97c8-4282-a894-025ca10dd600 req-f9ae2bcb-82e1-48da-9881-0f639a17ff20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b3c1f29-31c9-4f5c-9875-fd1939062512", "tag": "d234e00a-5520-40b5-aa3f-c3a3f2a506ee"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:26:26.528195 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=88 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:26:26.534208 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-be913263-97c8-4282-a894-025ca10dd600 req-f9ae2bcb-82e1-48da-9881-0f639a17ff20 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:26.534655 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-be913263-97c8-4282-a894-025ca10dd600 req-f9ae2bcb-82e1-48da-9881-0f639a17ff20 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:26.541934 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ad341623-4be9-4b1c-ae21-7be8fdabbc49 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:26.542765 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ad341623-4be9-4b1c-ae21-7be8fdabbc49 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:26.548212 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-be913263-97c8-4282-a894-025ca10dd600 req-f9ae2bcb-82e1-48da-9881-0f639a17ff20 service nova] Creating event network-changed:d234e00a-5520-40b5-aa3f-c3a3f2a506ee for instance 3b3c1f29-31c9-4f5c-9875-fd1939062512 on hv-cinder-84372 May 28 17:26:26.549342 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ad341623-4be9-4b1c-ae21-7be8fdabbc49 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:26.549867 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ad341623-4be9-4b1c-ae21-7be8fdabbc49 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:26.550831 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ad341623-4be9-4b1c-ae21-7be8fdabbc49 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:26.551527 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ad341623-4be9-4b1c-ae21-7be8fdabbc49 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:26.553349 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-be913263-97c8-4282-a894-025ca10dd600 req-f9ae2bcb-82e1-48da-9881-0f639a17ff20 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034414 May 28 17:26:26.554411 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 76/162] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:26:26.667252 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c07de957-f4ec-45a1-9d51-abacbfffcf70 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:26.669230 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c07de957-f4ec-45a1-9d51-abacbfffcf70 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:26.675233 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c07de957-f4ec-45a1-9d51-abacbfffcf70 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:26.675722 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c07de957-f4ec-45a1-9d51-abacbfffcf70 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:26.676502 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c07de957-f4ec-45a1-9d51-abacbfffcf70 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:26.676938 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c07de957-f4ec-45a1-9d51-abacbfffcf70 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:26.687878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ad341623-4be9-4b1c-ae21-7be8fdabbc49 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:26.695924 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ad341623-4be9-4b1c-ae21-7be8fdabbc49 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1319 microversion: 2.1 time: 0.157853 May 28 17:26:26.696564 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 87/163] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:26 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:26.814704 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c07de957-f4ec-45a1-9d51-abacbfffcf70 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:26.822544 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c07de957-f4ec-45a1-9d51-abacbfffcf70 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.159080 May 28 17:26:26.823127 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 77/164] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:26 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:27.719555 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b6d93b40-77de-4cad-bcee-447b2c85bd1f tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:27.720355 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b6d93b40-77de-4cad-bcee-447b2c85bd1f tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:27.726763 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b6d93b40-77de-4cad-bcee-447b2c85bd1f tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:27.727209 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b6d93b40-77de-4cad-bcee-447b2c85bd1f tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:27.728017 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b6d93b40-77de-4cad-bcee-447b2c85bd1f tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:27.728607 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b6d93b40-77de-4cad-bcee-447b2c85bd1f tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:27.840230 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-22219eff-f2ab-41e8-a058-ec0ee9d700d8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:27.840872 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-22219eff-f2ab-41e8-a058-ec0ee9d700d8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:27.848244 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-22219eff-f2ab-41e8-a058-ec0ee9d700d8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:27.848939 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-22219eff-f2ab-41e8-a058-ec0ee9d700d8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:27.850118 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-22219eff-f2ab-41e8-a058-ec0ee9d700d8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:27.850790 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-22219eff-f2ab-41e8-a058-ec0ee9d700d8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:27.864764 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b6d93b40-77de-4cad-bcee-447b2c85bd1f tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:27.873230 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b6d93b40-77de-4cad-bcee-447b2c85bd1f tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1319 microversion: 2.1 time: 0.162928 May 28 17:26:27.873797 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 88/165] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:27 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:27.986378 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-22219eff-f2ab-41e8-a058-ec0ee9d700d8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:27.995539 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-22219eff-f2ab-41e8-a058-ec0ee9d700d8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.159355 May 28 17:26:27.996263 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 78/166] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:27 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:28.894179 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-08c9af30-942d-4803-bdf0-73983cce41a1 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:28.894740 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-08c9af30-942d-4803-bdf0-73983cce41a1 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:28.897040 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=4 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:26:28.903864 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-08c9af30-942d-4803-bdf0-73983cce41a1 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:28.904310 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-08c9af30-942d-4803-bdf0-73983cce41a1 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:28.905066 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-08c9af30-942d-4803-bdf0-73983cce41a1 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:28.905490 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-08c9af30-942d-4803-bdf0-73983cce41a1 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:29.013248 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c3240277-fcb9-446b-8716-ae9b07c99fde tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:29.013961 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c3240277-fcb9-446b-8716-ae9b07c99fde tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:29.019943 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c3240277-fcb9-446b-8716-ae9b07c99fde tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:29.020459 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c3240277-fcb9-446b-8716-ae9b07c99fde tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:29.021280 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c3240277-fcb9-446b-8716-ae9b07c99fde tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:29.021799 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c3240277-fcb9-446b-8716-ae9b07c99fde tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:29.033562 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-08c9af30-942d-4803-bdf0-73983cce41a1 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:29.041252 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-08c9af30-942d-4803-bdf0-73983cce41a1 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1319 microversion: 2.1 time: 0.151009 May 28 17:26:29.041895 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 89/167] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:28 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:29.153106 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c3240277-fcb9-446b-8716-ae9b07c99fde tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:29.160359 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c3240277-fcb9-446b-8716-ae9b07c99fde tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.151646 May 28 17:26:29.160923 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 79/168] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:29 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:30.059556 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6a3179e9-0d62-45c7-91d2-ced5817cd09b tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:30.060145 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6a3179e9-0d62-45c7-91d2-ced5817cd09b tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:30.066549 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6a3179e9-0d62-45c7-91d2-ced5817cd09b tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:30.066990 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6a3179e9-0d62-45c7-91d2-ced5817cd09b tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:30.067777 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6a3179e9-0d62-45c7-91d2-ced5817cd09b tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:30.068213 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6a3179e9-0d62-45c7-91d2-ced5817cd09b tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:30.177335 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1721e39c-863f-4138-928f-2322e559e833 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:30.177961 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1721e39c-863f-4138-928f-2322e559e833 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:30.183926 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1721e39c-863f-4138-928f-2322e559e833 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:30.184376 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1721e39c-863f-4138-928f-2322e559e833 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:30.185132 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1721e39c-863f-4138-928f-2322e559e833 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:30.185568 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1721e39c-863f-4138-928f-2322e559e833 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:30.209140 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6a3179e9-0d62-45c7-91d2-ced5817cd09b tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:30.217430 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6a3179e9-0d62-45c7-91d2-ced5817cd09b tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1319 microversion: 2.1 time: 0.162514 May 28 17:26:30.218000 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 90/169] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:30 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:30.314965 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1721e39c-863f-4138-928f-2322e559e833 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:30.322881 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1721e39c-863f-4138-928f-2322e559e833 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.149224 May 28 17:26:30.323479 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 80/170] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:30 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:31.234653 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9d24a39f-af7b-46c0-b100-8e19a8b24721 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:31.235265 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9d24a39f-af7b-46c0-b100-8e19a8b24721 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:31.242652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9d24a39f-af7b-46c0-b100-8e19a8b24721 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:31.248197 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9d24a39f-af7b-46c0-b100-8e19a8b24721 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:31.248197 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9d24a39f-af7b-46c0-b100-8e19a8b24721 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:31.248197 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9d24a39f-af7b-46c0-b100-8e19a8b24721 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:31.340847 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8ac3e45e-e5fb-4ac8-a6e8-4c5c4d97d236 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:31.344043 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8ac3e45e-e5fb-4ac8-a6e8-4c5c4d97d236 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:31.350255 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8ac3e45e-e5fb-4ac8-a6e8-4c5c4d97d236 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:31.350701 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8ac3e45e-e5fb-4ac8-a6e8-4c5c4d97d236 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:31.351487 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8ac3e45e-e5fb-4ac8-a6e8-4c5c4d97d236 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:31.351927 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8ac3e45e-e5fb-4ac8-a6e8-4c5c4d97d236 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:31.385402 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9d24a39f-af7b-46c0-b100-8e19a8b24721 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:31.395412 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9d24a39f-af7b-46c0-b100-8e19a8b24721 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1319 microversion: 2.1 time: 0.165196 May 28 17:26:31.396005 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 91/171] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:31 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:31.505382 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8ac3e45e-e5fb-4ac8-a6e8-4c5c4d97d236 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:31.514687 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8ac3e45e-e5fb-4ac8-a6e8-4c5c4d97d236 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.178285 May 28 17:26:31.515239 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 81/172] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:31 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:32.412860 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5b7673fc-7f88-4c9e-8424-e57e30861101 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:32.413703 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5b7673fc-7f88-4c9e-8424-e57e30861101 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:32.420293 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5b7673fc-7f88-4c9e-8424-e57e30861101 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:32.420750 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5b7673fc-7f88-4c9e-8424-e57e30861101 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:32.421501 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5b7673fc-7f88-4c9e-8424-e57e30861101 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:32.421938 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5b7673fc-7f88-4c9e-8424-e57e30861101 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:32.532854 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f1328fe2-ef63-418f-b4fa-f282220c863e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:32.533484 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f1328fe2-ef63-418f-b4fa-f282220c863e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:32.540002 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f1328fe2-ef63-418f-b4fa-f282220c863e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:32.540407 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f1328fe2-ef63-418f-b4fa-f282220c863e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:32.541173 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f1328fe2-ef63-418f-b4fa-f282220c863e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:32.541608 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f1328fe2-ef63-418f-b4fa-f282220c863e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:32.553765 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5b7673fc-7f88-4c9e-8424-e57e30861101 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:32.563015 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5b7673fc-7f88-4c9e-8424-e57e30861101 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1319 microversion: 2.1 time: 0.154241 May 28 17:26:32.563763 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 92/173] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:32 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:32.679161 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f1328fe2-ef63-418f-b4fa-f282220c863e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:32.687435 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f1328fe2-ef63-418f-b4fa-f282220c863e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.158420 May 28 17:26:32.688010 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 82/174] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:32 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:33.580241 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d34de61d-7bbf-4020-98f8-d62e9f4a24dd tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:33.580845 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d34de61d-7bbf-4020-98f8-d62e9f4a24dd tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:33.587243 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d34de61d-7bbf-4020-98f8-d62e9f4a24dd tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:33.587715 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d34de61d-7bbf-4020-98f8-d62e9f4a24dd tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:33.588505 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d34de61d-7bbf-4020-98f8-d62e9f4a24dd tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:33.588935 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d34de61d-7bbf-4020-98f8-d62e9f4a24dd tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:33.704107 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0e6d6058-a68e-4759-b4aa-dded055ae8d2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:33.704718 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0e6d6058-a68e-4759-b4aa-dded055ae8d2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:33.710656 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0e6d6058-a68e-4759-b4aa-dded055ae8d2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:33.711108 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0e6d6058-a68e-4759-b4aa-dded055ae8d2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:33.711905 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0e6d6058-a68e-4759-b4aa-dded055ae8d2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:33.712343 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0e6d6058-a68e-4759-b4aa-dded055ae8d2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:33.718190 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d34de61d-7bbf-4020-98f8-d62e9f4a24dd tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:33.725968 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d34de61d-7bbf-4020-98f8-d62e9f4a24dd tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1319 microversion: 2.1 time: 0.149545 May 28 17:26:33.726536 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 93/175] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:33 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:33.847850 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0e6d6058-a68e-4759-b4aa-dded055ae8d2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:33.855150 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0e6d6058-a68e-4759-b4aa-dded055ae8d2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.154871 May 28 17:26:33.855741 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 83/176] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:33 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:34.743360 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-67c413cc-3374-4e0f-b5b1-9c1ba03d79c4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:34.744031 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-67c413cc-3374-4e0f-b5b1-9c1ba03d79c4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:34.750676 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-67c413cc-3374-4e0f-b5b1-9c1ba03d79c4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:34.751121 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-67c413cc-3374-4e0f-b5b1-9c1ba03d79c4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:34.751929 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-67c413cc-3374-4e0f-b5b1-9c1ba03d79c4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:34.752366 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-67c413cc-3374-4e0f-b5b1-9c1ba03d79c4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:34.872639 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-cde4f368-ff3f-4d11-a371-196408147517 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:34.873751 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-cde4f368-ff3f-4d11-a371-196408147517 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:34.879696 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cde4f368-ff3f-4d11-a371-196408147517 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:34.880122 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cde4f368-ff3f-4d11-a371-196408147517 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:34.880880 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cde4f368-ff3f-4d11-a371-196408147517 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:34.881311 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cde4f368-ff3f-4d11-a371-196408147517 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:34.888764 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-67c413cc-3374-4e0f-b5b1-9c1ba03d79c4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:34.896321 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-67c413cc-3374-4e0f-b5b1-9c1ba03d79c4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1319 microversion: 2.1 time: 0.156780 May 28 17:26:34.897277 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 94/177] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:34 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:35.023364 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-cde4f368-ff3f-4d11-a371-196408147517 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:35.032557 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-cde4f368-ff3f-4d11-a371-196408147517 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.164688 May 28 17:26:35.033133 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 84/178] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:34 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:35.913854 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9dd9d077-5b30-4178-9184-adfdeaf86ff3 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:35.914464 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9dd9d077-5b30-4178-9184-adfdeaf86ff3 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:35.921697 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9dd9d077-5b30-4178-9184-adfdeaf86ff3 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:35.922143 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9dd9d077-5b30-4178-9184-adfdeaf86ff3 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:35.922900 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9dd9d077-5b30-4178-9184-adfdeaf86ff3 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:35.923327 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9dd9d077-5b30-4178-9184-adfdeaf86ff3 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:36.049192 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e48d853d-56a5-4005-bd7c-e856478ccce0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:36.049807 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-e48d853d-56a5-4005-bd7c-e856478ccce0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:36.056817 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e48d853d-56a5-4005-bd7c-e856478ccce0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:36.057340 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e48d853d-56a5-4005-bd7c-e856478ccce0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:36.059041 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e48d853d-56a5-4005-bd7c-e856478ccce0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:36.059726 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e48d853d-56a5-4005-bd7c-e856478ccce0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:36.061127 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9dd9d077-5b30-4178-9184-adfdeaf86ff3 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:36.070510 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9dd9d077-5b30-4178-9184-adfdeaf86ff3 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1319 microversion: 2.1 time: 0.160388 May 28 17:26:36.080417 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 95/179] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:35 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:36.194379 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-e48d853d-56a5-4005-bd7c-e856478ccce0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:36.202182 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-e48d853d-56a5-4005-bd7c-e856478ccce0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.156712 May 28 17:26:36.202756 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 85/180] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:36 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:37.087124 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-bbbc0190-dc70-4377-b843-9a7d33454fe4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:37.087785 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-bbbc0190-dc70-4377-b843-9a7d33454fe4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:37.090327 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:26:37.095568 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bbbc0190-dc70-4377-b843-9a7d33454fe4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:37.096025 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bbbc0190-dc70-4377-b843-9a7d33454fe4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:37.097199 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bbbc0190-dc70-4377-b843-9a7d33454fe4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:37.097317 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bbbc0190-dc70-4377-b843-9a7d33454fe4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:37.219636 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-534d5b7c-b51b-4e87-86e2-477e8413764c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:37.221039 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-534d5b7c-b51b-4e87-86e2-477e8413764c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:37.228262 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-534d5b7c-b51b-4e87-86e2-477e8413764c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:37.228913 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-534d5b7c-b51b-4e87-86e2-477e8413764c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:37.229880 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-534d5b7c-b51b-4e87-86e2-477e8413764c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:37.231009 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-534d5b7c-b51b-4e87-86e2-477e8413764c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:37.256862 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-bbbc0190-dc70-4377-b843-9a7d33454fe4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:37.265714 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-bbbc0190-dc70-4377-b843-9a7d33454fe4 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1319 microversion: 2.1 time: 0.182311 May 28 17:26:37.266312 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 96/181] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:37 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:37.503310 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-534d5b7c-b51b-4e87-86e2-477e8413764c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:37.505754 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=100 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:26:37.512233 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-534d5b7c-b51b-4e87-86e2-477e8413764c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.296446 May 28 17:26:37.512803 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 86/182] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:37 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:38.283539 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-91c0ebeb-cebe-451d-9267-7741a09759b9 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:38.284149 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-91c0ebeb-cebe-451d-9267-7741a09759b9 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:38.290515 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-91c0ebeb-cebe-451d-9267-7741a09759b9 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:38.290965 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-91c0ebeb-cebe-451d-9267-7741a09759b9 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:38.291743 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-91c0ebeb-cebe-451d-9267-7741a09759b9 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:38.292211 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-91c0ebeb-cebe-451d-9267-7741a09759b9 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:38.420169 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-91c0ebeb-cebe-451d-9267-7741a09759b9 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:38.427506 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-91c0ebeb-cebe-451d-9267-7741a09759b9 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1319 microversion: 2.1 time: 0.147780 May 28 17:26:38.428068 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 97/183] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:38 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:38.531137 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1927394b-82c6-43ef-a4b8-d81549c5b0ed tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:38.531771 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1927394b-82c6-43ef-a4b8-d81549c5b0ed tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:38.537708 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1927394b-82c6-43ef-a4b8-d81549c5b0ed tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:38.538152 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1927394b-82c6-43ef-a4b8-d81549c5b0ed tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:38.538895 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1927394b-82c6-43ef-a4b8-d81549c5b0ed tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:38.539325 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1927394b-82c6-43ef-a4b8-d81549c5b0ed tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:38.669285 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1927394b-82c6-43ef-a4b8-d81549c5b0ed tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:38.676949 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1927394b-82c6-43ef-a4b8-d81549c5b0ed tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.151373 May 28 17:26:38.677507 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 87/184] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:38 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:39.443781 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-84d5f5f5-bf06-404e-91d4-c0964519825e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:39.444406 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-84d5f5f5-bf06-404e-91d4-c0964519825e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:39.452056 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-84d5f5f5-bf06-404e-91d4-c0964519825e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:39.452499 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-84d5f5f5-bf06-404e-91d4-c0964519825e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:39.453248 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-84d5f5f5-bf06-404e-91d4-c0964519825e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:39.453673 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-84d5f5f5-bf06-404e-91d4-c0964519825e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:39.587469 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-84d5f5f5-bf06-404e-91d4-c0964519825e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:39.594798 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-84d5f5f5-bf06-404e-91d4-c0964519825e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1319 microversion: 2.1 time: 0.154827 May 28 17:26:39.595388 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 98/185] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:39 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:39.693544 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5604c981-2400-4c1f-bf50-42a519445836 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:39.694160 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5604c981-2400-4c1f-bf50-42a519445836 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:39.700412 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5604c981-2400-4c1f-bf50-42a519445836 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:39.701060 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5604c981-2400-4c1f-bf50-42a519445836 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:39.702382 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5604c981-2400-4c1f-bf50-42a519445836 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:39.702949 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5604c981-2400-4c1f-bf50-42a519445836 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:39.834947 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5604c981-2400-4c1f-bf50-42a519445836 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:39.843254 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5604c981-2400-4c1f-bf50-42a519445836 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.153594 May 28 17:26:39.843836 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 88/186] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:39 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:40.611660 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-37c7cd82-332c-45f2-87b6-42c8affd0a27 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:40.612306 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-37c7cd82-332c-45f2-87b6-42c8affd0a27 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:40.619073 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-37c7cd82-332c-45f2-87b6-42c8affd0a27 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:40.619558 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-37c7cd82-332c-45f2-87b6-42c8affd0a27 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:40.620858 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-37c7cd82-332c-45f2-87b6-42c8affd0a27 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:40.621411 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-37c7cd82-332c-45f2-87b6-42c8affd0a27 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:40.755629 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-37c7cd82-332c-45f2-87b6-42c8affd0a27 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:40.763711 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-37c7cd82-332c-45f2-87b6-42c8affd0a27 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1319 microversion: 2.1 time: 0.155868 May 28 17:26:40.764273 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 99/187] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:40 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:40.860249 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ebd670df-3926-4c21-b0cf-796980e551b3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:40.860763 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ebd670df-3926-4c21-b0cf-796980e551b3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:40.866735 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ebd670df-3926-4c21-b0cf-796980e551b3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:40.867175 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ebd670df-3926-4c21-b0cf-796980e551b3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:40.867952 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ebd670df-3926-4c21-b0cf-796980e551b3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:40.868385 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ebd670df-3926-4c21-b0cf-796980e551b3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:41.006085 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ebd670df-3926-4c21-b0cf-796980e551b3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:41.013835 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ebd670df-3926-4c21-b0cf-796980e551b3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.157474 May 28 17:26:41.014607 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 89/188] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:40 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:41.781392 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-30316941-2f49-4f6d-98af-b15d966838ba tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:41.781996 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-30316941-2f49-4f6d-98af-b15d966838ba tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:41.788425 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-30316941-2f49-4f6d-98af-b15d966838ba tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:41.788862 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-30316941-2f49-4f6d-98af-b15d966838ba tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:41.789610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-30316941-2f49-4f6d-98af-b15d966838ba tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:41.790037 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-30316941-2f49-4f6d-98af-b15d966838ba tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:41.916105 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-30316941-2f49-4f6d-98af-b15d966838ba tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:41.923544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-30316941-2f49-4f6d-98af-b15d966838ba tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1319 microversion: 2.1 time: 0.147109 May 28 17:26:41.924105 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 100/189] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:41 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:42.030539 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3e914679-7772-4385-aed7-4ba4f5a5c0a2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:42.031162 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3e914679-7772-4385-aed7-4ba4f5a5c0a2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:42.037427 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3e914679-7772-4385-aed7-4ba4f5a5c0a2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:42.037882 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3e914679-7772-4385-aed7-4ba4f5a5c0a2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:42.038653 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3e914679-7772-4385-aed7-4ba4f5a5c0a2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:42.039095 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3e914679-7772-4385-aed7-4ba4f5a5c0a2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:42.174196 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3e914679-7772-4385-aed7-4ba4f5a5c0a2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:42.181848 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3e914679-7772-4385-aed7-4ba4f5a5c0a2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.155788 May 28 17:26:42.182597 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 90/190] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:42 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:42.940573 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e66b602d-44bb-43ed-b0ef-c58501cfc92e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:42.941195 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e66b602d-44bb-43ed-b0ef-c58501cfc92e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:42.948836 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e66b602d-44bb-43ed-b0ef-c58501cfc92e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:42.949292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e66b602d-44bb-43ed-b0ef-c58501cfc92e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:42.950063 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e66b602d-44bb-43ed-b0ef-c58501cfc92e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:42.950511 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e66b602d-44bb-43ed-b0ef-c58501cfc92e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:43.086074 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e66b602d-44bb-43ed-b0ef-c58501cfc92e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:43.094130 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e66b602d-44bb-43ed-b0ef-c58501cfc92e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1319 microversion: 2.1 time: 0.157638 May 28 17:26:43.094950 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 101/191] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:42 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:43.200312 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-25b6cb8d-c57f-41cc-a607-06b7592f8aed tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:43.201007 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-25b6cb8d-c57f-41cc-a607-06b7592f8aed tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:43.208492 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-25b6cb8d-c57f-41cc-a607-06b7592f8aed tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:43.209021 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-25b6cb8d-c57f-41cc-a607-06b7592f8aed tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:43.211230 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-25b6cb8d-c57f-41cc-a607-06b7592f8aed tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:43.211230 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-25b6cb8d-c57f-41cc-a607-06b7592f8aed tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:43.343265 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-25b6cb8d-c57f-41cc-a607-06b7592f8aed tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:43.350523 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-25b6cb8d-c57f-41cc-a607-06b7592f8aed tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.154185 May 28 17:26:43.351081 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 91/192] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:43 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:44.110322 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8d89a316-b69f-43dc-a159-76d149be2301 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:44.110938 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8d89a316-b69f-43dc-a159-76d149be2301 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:44.117477 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8d89a316-b69f-43dc-a159-76d149be2301 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:44.117932 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8d89a316-b69f-43dc-a159-76d149be2301 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:44.118688 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8d89a316-b69f-43dc-a159-76d149be2301 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:44.119245 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8d89a316-b69f-43dc-a159-76d149be2301 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:44.259529 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8d89a316-b69f-43dc-a159-76d149be2301 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:44.265016 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=100 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:26:44.271651 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8d89a316-b69f-43dc-a159-76d149be2301 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1319 microversion: 2.1 time: 0.165037 May 28 17:26:44.272241 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 102/193] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:44 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:44.366938 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6dff93ed-31e1-4512-aeb9-d53123086ca6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:44.367779 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6dff93ed-31e1-4512-aeb9-d53123086ca6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:44.374495 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6dff93ed-31e1-4512-aeb9-d53123086ca6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:44.374955 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6dff93ed-31e1-4512-aeb9-d53123086ca6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:44.375763 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6dff93ed-31e1-4512-aeb9-d53123086ca6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:44.376209 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6dff93ed-31e1-4512-aeb9-d53123086ca6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:44.525680 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-6dff93ed-31e1-4512-aeb9-d53123086ca6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:44.536994 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6dff93ed-31e1-4512-aeb9-d53123086ca6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.174435 May 28 17:26:44.537600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 92/194] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:44 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:45.289214 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-84c5dced-f064-41b4-8b63-ccc83aefcdce tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:45.289838 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-84c5dced-f064-41b4-8b63-ccc83aefcdce tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:45.296930 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-84c5dced-f064-41b4-8b63-ccc83aefcdce tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:45.297386 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-84c5dced-f064-41b4-8b63-ccc83aefcdce tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:45.298160 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-84c5dced-f064-41b4-8b63-ccc83aefcdce tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:45.298600 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-84c5dced-f064-41b4-8b63-ccc83aefcdce tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:45.452777 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-84c5dced-f064-41b4-8b63-ccc83aefcdce tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:45.460472 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-84c5dced-f064-41b4-8b63-ccc83aefcdce tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1319 microversion: 2.1 time: 0.175675 May 28 17:26:45.461095 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 103/195] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:45 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:45.554273 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-928b0987-d7a0-4bbb-b581-b5bb8be72c81 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:45.554879 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-928b0987-d7a0-4bbb-b581-b5bb8be72c81 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:45.561243 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-928b0987-d7a0-4bbb-b581-b5bb8be72c81 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:45.561698 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-928b0987-d7a0-4bbb-b581-b5bb8be72c81 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:45.562475 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-928b0987-d7a0-4bbb-b581-b5bb8be72c81 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:45.562912 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-928b0987-d7a0-4bbb-b581-b5bb8be72c81 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:45.818717 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-928b0987-d7a0-4bbb-b581-b5bb8be72c81 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:45.827149 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-928b0987-d7a0-4bbb-b581-b5bb8be72c81 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.276785 May 28 17:26:45.827768 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 93/196] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:45 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:46.478533 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-7cbe481f-1dc5-46ac-ad96-58919a2b873a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:46.479152 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-7cbe481f-1dc5-46ac-ad96-58919a2b873a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:46.486078 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7cbe481f-1dc5-46ac-ad96-58919a2b873a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:46.486482 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7cbe481f-1dc5-46ac-ad96-58919a2b873a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:46.487252 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7cbe481f-1dc5-46ac-ad96-58919a2b873a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:46.487773 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7cbe481f-1dc5-46ac-ad96-58919a2b873a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:46.820448 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7cbe481f-1dc5-46ac-ad96-58919a2b873a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:46.827172 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-7cbe481f-1dc5-46ac-ad96-58919a2b873a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1319 microversion: 2.1 time: 0.352918 May 28 17:26:46.827758 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 104/197] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:46 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1319 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:46.844981 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1d05c961-64fc-4d78-9015-c083622e21cd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:46.845816 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1d05c961-64fc-4d78-9015-c083622e21cd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:46.851832 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1d05c961-64fc-4d78-9015-c083622e21cd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:46.852271 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1d05c961-64fc-4d78-9015-c083622e21cd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:46.853020 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1d05c961-64fc-4d78-9015-c083622e21cd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:46.853634 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1d05c961-64fc-4d78-9015-c083622e21cd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:46.991026 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1d05c961-64fc-4d78-9015-c083622e21cd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:46.999315 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1d05c961-64fc-4d78-9015-c083622e21cd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.158190 May 28 17:26:46.999903 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 94/198] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:46 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:47.844600 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-da8be76e-ea4c-4b35-ae3b-ee2b4875b765 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:47.845257 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-da8be76e-ea4c-4b35-ae3b-ee2b4875b765 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:47.853601 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-da8be76e-ea4c-4b35-ae3b-ee2b4875b765 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:47.854122 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-da8be76e-ea4c-4b35-ae3b-ee2b4875b765 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:47.855077 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-da8be76e-ea4c-4b35-ae3b-ee2b4875b765 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:47.855611 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-da8be76e-ea4c-4b35-ae3b-ee2b4875b765 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:47.994988 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-da8be76e-ea4c-4b35-ae3b-ee2b4875b765 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:48.002974 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-da8be76e-ea4c-4b35-ae3b-ee2b4875b765 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1319 microversion: 2.1 time: 0.162309 May 28 17:26:48.003569 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 105/199] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:47 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:48.016312 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a4187b1f-53b6-41f8-895c-12ca72b2bd91 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:48.016884 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a4187b1f-53b6-41f8-895c-12ca72b2bd91 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:48.022860 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a4187b1f-53b6-41f8-895c-12ca72b2bd91 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:48.023307 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a4187b1f-53b6-41f8-895c-12ca72b2bd91 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:48.024281 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a4187b1f-53b6-41f8-895c-12ca72b2bd91 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:48.024715 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a4187b1f-53b6-41f8-895c-12ca72b2bd91 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:48.163187 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a4187b1f-53b6-41f8-895c-12ca72b2bd91 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:48.171553 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a4187b1f-53b6-41f8-895c-12ca72b2bd91 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.158817 May 28 17:26:48.172111 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 95/200] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:48 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:49.020585 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-08bbd0bf-2acc-46f2-923e-69b821676d44 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:49.021281 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-08bbd0bf-2acc-46f2-923e-69b821676d44 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:49.029724 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-08bbd0bf-2acc-46f2-923e-69b821676d44 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:49.030374 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-08bbd0bf-2acc-46f2-923e-69b821676d44 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:49.031687 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-08bbd0bf-2acc-46f2-923e-69b821676d44 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:49.032125 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-08bbd0bf-2acc-46f2-923e-69b821676d44 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:49.191301 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9daf3c86-670c-40ac-9962-2ae31f27e0c0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:49.192764 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9daf3c86-670c-40ac-9962-2ae31f27e0c0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:49.202080 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9daf3c86-670c-40ac-9962-2ae31f27e0c0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:49.203510 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9daf3c86-670c-40ac-9962-2ae31f27e0c0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:49.205615 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9daf3c86-670c-40ac-9962-2ae31f27e0c0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:49.206144 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9daf3c86-670c-40ac-9962-2ae31f27e0c0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:49.222993 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-08bbd0bf-2acc-46f2-923e-69b821676d44 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:49.232825 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-08bbd0bf-2acc-46f2-923e-69b821676d44 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1319 microversion: 2.1 time: 0.216331 May 28 17:26:49.233681 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 106/201] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:49 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:49.239825 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-f80737eb-0500-47a8-942f-0a79451e0778 req-73371b6b-d26a-4d2e-a3b8-6e8bbc07d1db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e99fbe7a-b9c4-4f37-a515-9e598de8b512", "name": "network-vif-plugged", "status": "completed", "tag": "0bfab207-935d-43ec-8b14-0efcb1026c51"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:26:49.252410 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-f80737eb-0500-47a8-942f-0a79451e0778 req-73371b6b-d26a-4d2e-a3b8-6e8bbc07d1db service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:49.254146 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-f80737eb-0500-47a8-942f-0a79451e0778 req-73371b6b-d26a-4d2e-a3b8-6e8bbc07d1db service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:49.269693 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-f80737eb-0500-47a8-942f-0a79451e0778 req-73371b6b-d26a-4d2e-a3b8-6e8bbc07d1db service nova] Creating event network-vif-plugged:0bfab207-935d-43ec-8b14-0efcb1026c51 for instance e99fbe7a-b9c4-4f37-a515-9e598de8b512 on hv-cinder-84372 May 28 17:26:49.276765 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-f80737eb-0500-47a8-942f-0a79451e0778 req-73371b6b-d26a-4d2e-a3b8-6e8bbc07d1db service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041478 May 28 17:26:49.278271 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 107/202] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:26:49.407856 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-9daf3c86-670c-40ac-9962-2ae31f27e0c0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:49.416504 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9daf3c86-670c-40ac-9962-2ae31f27e0c0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.231277 May 28 17:26:49.417618 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 96/203] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:49 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:50.252246 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1c37c02f-3235-4e18-9d93-c1441c24594c tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:50.252948 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1c37c02f-3235-4e18-9d93-c1441c24594c tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:50.261571 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c37c02f-3235-4e18-9d93-c1441c24594c tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:50.262028 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c37c02f-3235-4e18-9d93-c1441c24594c tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:50.263274 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c37c02f-3235-4e18-9d93-c1441c24594c tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:50.264053 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c37c02f-3235-4e18-9d93-c1441c24594c tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:50.438530 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-33693f67-fa79-492f-b39b-14578181c68a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:50.440040 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-33693f67-fa79-492f-b39b-14578181c68a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:50.459694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-33693f67-fa79-492f-b39b-14578181c68a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:50.460157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-33693f67-fa79-492f-b39b-14578181c68a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:50.460951 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-33693f67-fa79-492f-b39b-14578181c68a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:50.464926 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-33693f67-fa79-492f-b39b-14578181c68a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:50.489809 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1c37c02f-3235-4e18-9d93-c1441c24594c tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:50.505548 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1c37c02f-3235-4e18-9d93-c1441c24594c tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1319 microversion: 2.1 time: 0.258833 May 28 17:26:50.506388 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 108/204] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:50 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:50.704020 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-33693f67-fa79-492f-b39b-14578181c68a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:50.713365 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-33693f67-fa79-492f-b39b-14578181c68a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.283163 May 28 17:26:50.714929 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 97/205] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:50 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:51.528488 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-68999eef-e081-4528-a401-a38c68b3314f tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:51.529815 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-68999eef-e081-4528-a401-a38c68b3314f tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:51.540351 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-68999eef-e081-4528-a401-a38c68b3314f tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:51.541004 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-68999eef-e081-4528-a401-a38c68b3314f tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:51.541926 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-68999eef-e081-4528-a401-a38c68b3314f tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:51.543144 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-68999eef-e081-4528-a401-a38c68b3314f tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:51.715693 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-68999eef-e081-4528-a401-a38c68b3314f tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:51.727911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-68999eef-e081-4528-a401-a38c68b3314f tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1319 microversion: 2.1 time: 0.207419 May 28 17:26:51.728569 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 109/206] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:51 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:51.733332 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ce7cceb7-1fbb-473a-bc95-980347c71627 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:51.733954 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ce7cceb7-1fbb-473a-bc95-980347c71627 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:51.740084 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ce7cceb7-1fbb-473a-bc95-980347c71627 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:51.740720 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ce7cceb7-1fbb-473a-bc95-980347c71627 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:51.741491 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ce7cceb7-1fbb-473a-bc95-980347c71627 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:51.741932 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ce7cceb7-1fbb-473a-bc95-980347c71627 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:51.845172 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8deb3ca5-1687-41d2-a567-484619b60f4d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:51.845666 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8deb3ca5-1687-41d2-a567-484619b60f4d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:51.851967 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8deb3ca5-1687-41d2-a567-484619b60f4d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:51.852408 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8deb3ca5-1687-41d2-a567-484619b60f4d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:51.853159 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8deb3ca5-1687-41d2-a567-484619b60f4d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:51.853587 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8deb3ca5-1687-41d2-a567-484619b60f4d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:51.895913 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8deb3ca5-1687-41d2-a567-484619b60f4d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Going to try to terminate instance {{(pid=117604) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 17:26:51.913737 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ce7cceb7-1fbb-473a-bc95-980347c71627 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:51.924734 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ce7cceb7-1fbb-473a-bc95-980347c71627 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.196078 May 28 17:26:51.926228 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 98/207] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:51 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:51.992435 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8deb3ca5-1687-41d2-a567-484619b60f4d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 204 len: 0 microversion: 2.1 time: 0.151482 May 28 17:26:51.993010 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 110/208] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 17:26:51 2022] DELETE /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 17:26:52.003947 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d7cc1336-a2ef-46ed-931d-e32a4eecc485 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:52.003947 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d7cc1336-a2ef-46ed-931d-e32a4eecc485 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:52.008422 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d7cc1336-a2ef-46ed-931d-e32a4eecc485 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:52.008868 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d7cc1336-a2ef-46ed-931d-e32a4eecc485 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:52.009622 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d7cc1336-a2ef-46ed-931d-e32a4eecc485 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:52.010055 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d7cc1336-a2ef-46ed-931d-e32a4eecc485 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:52.159776 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d7cc1336-a2ef-46ed-931d-e32a4eecc485 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:52.167802 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d7cc1336-a2ef-46ed-931d-e32a4eecc485 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1555 microversion: 2.1 time: 0.169624 May 28 17:26:52.168368 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 99/209] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:51 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:52.749858 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f0a2dd6d-e591-49a6-aa53-68a6644662d8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:52.750496 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f0a2dd6d-e591-49a6-aa53-68a6644662d8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:52.774743 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f0a2dd6d-e591-49a6-aa53-68a6644662d8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:52.775196 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f0a2dd6d-e591-49a6-aa53-68a6644662d8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:52.783235 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f0a2dd6d-e591-49a6-aa53-68a6644662d8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:52.788753 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f0a2dd6d-e591-49a6-aa53-68a6644662d8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:52.944526 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3b056a5f-2e77-4c16-aaaa-0ad62b0a9e07 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:52.945147 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3b056a5f-2e77-4c16-aaaa-0ad62b0a9e07 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:52.951905 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3b056a5f-2e77-4c16-aaaa-0ad62b0a9e07 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:52.953419 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3b056a5f-2e77-4c16-aaaa-0ad62b0a9e07 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:52.955151 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3b056a5f-2e77-4c16-aaaa-0ad62b0a9e07 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:52.956278 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3b056a5f-2e77-4c16-aaaa-0ad62b0a9e07 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:53.034687 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f0a2dd6d-e591-49a6-aa53-68a6644662d8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:53.045573 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f0a2dd6d-e591-49a6-aa53-68a6644662d8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1319 microversion: 2.1 time: 0.303994 May 28 17:26:53.046514 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 111/210] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:52 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:53.110429 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3b056a5f-2e77-4c16-aaaa-0ad62b0a9e07 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:53.118859 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3b056a5f-2e77-4c16-aaaa-0ad62b0a9e07 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1321 microversion: 2.1 time: 0.179013 May 28 17:26:53.119600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 100/211] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:52 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:53.186095 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ba572c56-d790-4236-9a6d-5589c9314a0a tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:53.186698 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ba572c56-d790-4236-9a6d-5589c9314a0a tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:53.192660 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ba572c56-d790-4236-9a6d-5589c9314a0a tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:53.193111 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ba572c56-d790-4236-9a6d-5589c9314a0a tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:53.193876 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ba572c56-d790-4236-9a6d-5589c9314a0a tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:53.194436 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ba572c56-d790-4236-9a6d-5589c9314a0a tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:53.345743 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ba572c56-d790-4236-9a6d-5589c9314a0a tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:53.358439 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ba572c56-d790-4236-9a6d-5589c9314a0a tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1555 microversion: 2.1 time: 0.175205 May 28 17:26:53.359210 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 112/212] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:53 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1555 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:54.062160 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-00b53cdf-259c-417f-92f4-2b40e8547b75 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:54.062768 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-00b53cdf-259c-417f-92f4-2b40e8547b75 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:54.069033 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-00b53cdf-259c-417f-92f4-2b40e8547b75 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:54.069475 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-00b53cdf-259c-417f-92f4-2b40e8547b75 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:54.070224 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-00b53cdf-259c-417f-92f4-2b40e8547b75 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:54.070654 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-00b53cdf-259c-417f-92f4-2b40e8547b75 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:54.137316 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d527715e-2c0f-426d-87e1-e9b31143b80d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:54.138031 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d527715e-2c0f-426d-87e1-e9b31143b80d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:54.145092 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d527715e-2c0f-426d-87e1-e9b31143b80d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:54.145542 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d527715e-2c0f-426d-87e1-e9b31143b80d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:54.146298 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d527715e-2c0f-426d-87e1-e9b31143b80d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:54.146730 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d527715e-2c0f-426d-87e1-e9b31143b80d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:54.208589 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-00b53cdf-259c-417f-92f4-2b40e8547b75 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:54.216991 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-00b53cdf-259c-417f-92f4-2b40e8547b75 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1319 microversion: 2.1 time: 0.158762 May 28 17:26:54.218129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 101/213] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:54 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:54.295501 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d527715e-2c0f-426d-87e1-e9b31143b80d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:54.303514 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d527715e-2c0f-426d-87e1-e9b31143b80d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1515 microversion: 2.1 time: 0.171165 May 28 17:26:54.304075 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 113/214] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:54 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:54.321077 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4b9787b7-1073-41e1-ac36-d438b7c884bb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:26:54.322018 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4b9787b7-1073-41e1-ac36-d438b7c884bb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:54.328728 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4b9787b7-1073-41e1-ac36-d438b7c884bb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:54.329212 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4b9787b7-1073-41e1-ac36-d438b7c884bb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:54.329974 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4b9787b7-1073-41e1-ac36-d438b7c884bb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:54.330414 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4b9787b7-1073-41e1-ac36-d438b7c884bb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:54.377308 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a2bc2d2c-6a3b-4f71-a1f9-a274fa5a69df tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:54.377930 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a2bc2d2c-6a3b-4f71-a1f9-a274fa5a69df tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:54.383757 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a2bc2d2c-6a3b-4f71-a1f9-a274fa5a69df tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:54.384203 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a2bc2d2c-6a3b-4f71-a1f9-a274fa5a69df tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:54.384944 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a2bc2d2c-6a3b-4f71-a1f9-a274fa5a69df tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:54.385388 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a2bc2d2c-6a3b-4f71-a1f9-a274fa5a69df tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:54.392563 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-4b9787b7-1073-41e1-ac36-d438b7c884bb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lazy-loading 'flavor' on Instance uuid 9d6203f1-8344-4493-9b94-22fb56f73a96 {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 17:26:54.458022 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=100 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:26:54.509672 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4b9787b7-1073-41e1-ac36-d438b7c884bb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "POST /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96/action" status: 200 len: 32 microversion: 2.1 time: 0.192613 May 28 17:26:54.510282 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 102/215] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 17:26:54 2022] POST /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96/action => generated 32 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 28 17:26:54.519400 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9e825946-4677-44e8-99fc-720220529f17 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:54.519561 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a2bc2d2c-6a3b-4f71-a1f9-a274fa5a69df tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:54.520105 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9e825946-4677-44e8-99fc-720220529f17 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:54.527869 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a2bc2d2c-6a3b-4f71-a1f9-a274fa5a69df tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1555 microversion: 2.1 time: 0.154213 May 28 17:26:54.528674 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 114/216] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:54 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:54.536499 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9e825946-4677-44e8-99fc-720220529f17 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:54.537236 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9e825946-4677-44e8-99fc-720220529f17 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:54.538124 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9e825946-4677-44e8-99fc-720220529f17 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:54.538705 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9e825946-4677-44e8-99fc-720220529f17 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:54.671186 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-9e825946-4677-44e8-99fc-720220529f17 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:54.678773 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9e825946-4677-44e8-99fc-720220529f17 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.163341 May 28 17:26:54.679331 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 103/217] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:54 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:55.234595 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9596f39b-f946-41af-8797-51dd3c6858d8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:55.235206 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9596f39b-f946-41af-8797-51dd3c6858d8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:55.241672 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9596f39b-f946-41af-8797-51dd3c6858d8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:55.242124 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9596f39b-f946-41af-8797-51dd3c6858d8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:55.242876 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9596f39b-f946-41af-8797-51dd3c6858d8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:55.243313 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9596f39b-f946-41af-8797-51dd3c6858d8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:55.458659 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9596f39b-f946-41af-8797-51dd3c6858d8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:55.467634 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9596f39b-f946-41af-8797-51dd3c6858d8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1319 microversion: 2.1 time: 0.236827 May 28 17:26:55.468209 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 115/218] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:55 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:55.546167 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c18f5b1d-bc9c-4b21-9c0c-da55bff86b9d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:55.546786 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c18f5b1d-bc9c-4b21-9c0c-da55bff86b9d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:55.552678 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c18f5b1d-bc9c-4b21-9c0c-da55bff86b9d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:55.553130 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c18f5b1d-bc9c-4b21-9c0c-da55bff86b9d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:55.553896 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c18f5b1d-bc9c-4b21-9c0c-da55bff86b9d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:55.554336 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c18f5b1d-bc9c-4b21-9c0c-da55bff86b9d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:55.686453 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c18f5b1d-bc9c-4b21-9c0c-da55bff86b9d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:55.696097 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c18f5b1d-bc9c-4b21-9c0c-da55bff86b9d tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1555 microversion: 2.1 time: 0.154796 May 28 17:26:55.696287 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-47090800-c118-4d10-835c-66e46c5a2fd8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:55.696669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 104/219] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:55 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:55.696945 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-47090800-c118-4d10-835c-66e46c5a2fd8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:55.703380 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-47090800-c118-4d10-835c-66e46c5a2fd8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:55.704012 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-47090800-c118-4d10-835c-66e46c5a2fd8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:55.704781 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-47090800-c118-4d10-835c-66e46c5a2fd8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:55.705212 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-47090800-c118-4d10-835c-66e46c5a2fd8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:55.840475 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-47090800-c118-4d10-835c-66e46c5a2fd8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:55.847770 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-47090800-c118-4d10-835c-66e46c5a2fd8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.155438 May 28 17:26:55.848334 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 116/220] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:55 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:56.484857 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-40e2f5d4-7d95-4e33-8a90-dcf52262675d tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:56.485465 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-40e2f5d4-7d95-4e33-8a90-dcf52262675d tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:56.491634 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-40e2f5d4-7d95-4e33-8a90-dcf52262675d tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:56.492081 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-40e2f5d4-7d95-4e33-8a90-dcf52262675d tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:56.492844 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-40e2f5d4-7d95-4e33-8a90-dcf52262675d tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:56.493278 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-40e2f5d4-7d95-4e33-8a90-dcf52262675d tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:56.638229 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-40e2f5d4-7d95-4e33-8a90-dcf52262675d tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:56.646988 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-40e2f5d4-7d95-4e33-8a90-dcf52262675d tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1509 microversion: 2.1 time: 0.165592 May 28 17:26:56.648027 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 105/221] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:56 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:56.720137 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b9b771be-7249-46f0-b29b-64b62a6a84e6 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:56.721877 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b9b771be-7249-46f0-b29b-64b62a6a84e6 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:56.729092 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b9b771be-7249-46f0-b29b-64b62a6a84e6 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:56.730298 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b9b771be-7249-46f0-b29b-64b62a6a84e6 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:56.731233 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b9b771be-7249-46f0-b29b-64b62a6a84e6 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:56.731694 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b9b771be-7249-46f0-b29b-64b62a6a84e6 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:56.865609 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f99c46cf-6830-4d59-a5c6-ecd2e84ce38f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:56.866756 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f99c46cf-6830-4d59-a5c6-ecd2e84ce38f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:56.873076 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=60 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:26:56.875331 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f99c46cf-6830-4d59-a5c6-ecd2e84ce38f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:56.876025 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f99c46cf-6830-4d59-a5c6-ecd2e84ce38f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:56.877153 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f99c46cf-6830-4d59-a5c6-ecd2e84ce38f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:56.877745 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f99c46cf-6830-4d59-a5c6-ecd2e84ce38f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:56.896774 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b9b771be-7249-46f0-b29b-64b62a6a84e6 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:56.909271 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b9b771be-7249-46f0-b29b-64b62a6a84e6 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1555 microversion: 2.1 time: 0.199311 May 28 17:26:56.909972 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 117/222] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:56 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1555 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:57.049241 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f99c46cf-6830-4d59-a5c6-ecd2e84ce38f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:57.063984 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f99c46cf-6830-4d59-a5c6-ecd2e84ce38f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.202204 May 28 17:26:57.064778 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 106/223] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:56 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:57.926980 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5abd450d-a6f8-4724-acbb-5e6926083d54 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:57.927619 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5abd450d-a6f8-4724-acbb-5e6926083d54 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:57.934734 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5abd450d-a6f8-4724-acbb-5e6926083d54 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:57.935191 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5abd450d-a6f8-4724-acbb-5e6926083d54 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:57.935999 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5abd450d-a6f8-4724-acbb-5e6926083d54 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:57.936443 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5abd450d-a6f8-4724-acbb-5e6926083d54 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:57.956292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:26:58.071528 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5abd450d-a6f8-4724-acbb-5e6926083d54 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:58.080475 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5abd450d-a6f8-4724-acbb-5e6926083d54 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1555 microversion: 2.1 time: 0.157320 May 28 17:26:58.081033 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 118/224] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:57 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:58.081157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2b646572-2f92-4e57-b84b-37d9d4f88d70 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:58.081818 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2b646572-2f92-4e57-b84b-37d9d4f88d70 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:58.088212 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2b646572-2f92-4e57-b84b-37d9d4f88d70 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:58.088732 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2b646572-2f92-4e57-b84b-37d9d4f88d70 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:58.089552 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2b646572-2f92-4e57-b84b-37d9d4f88d70 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:58.090026 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2b646572-2f92-4e57-b84b-37d9d4f88d70 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:58.222997 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2b646572-2f92-4e57-b84b-37d9d4f88d70 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:58.230901 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2b646572-2f92-4e57-b84b-37d9d4f88d70 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.153656 May 28 17:26:58.231490 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 107/225] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:58 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:26:59.097225 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a4e76da5-0ae3-4ab5-b948-c971390b65e5 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:59.097836 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a4e76da5-0ae3-4ab5-b948-c971390b65e5 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:59.104396 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a4e76da5-0ae3-4ab5-b948-c971390b65e5 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:59.104976 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a4e76da5-0ae3-4ab5-b948-c971390b65e5 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:59.105796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a4e76da5-0ae3-4ab5-b948-c971390b65e5 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:59.106226 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a4e76da5-0ae3-4ab5-b948-c971390b65e5 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:59.239426 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a4e76da5-0ae3-4ab5-b948-c971390b65e5 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:59.247793 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f6f79d42-a049-4f7c-9149-6385e1bd73a5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:26:59.248507 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f6f79d42-a049-4f7c-9149-6385e1bd73a5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:26:59.248949 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a4e76da5-0ae3-4ab5-b948-c971390b65e5 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1555 microversion: 2.1 time: 0.155064 May 28 17:26:59.250027 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 119/226] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:59 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:26:59.254817 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f6f79d42-a049-4f7c-9149-6385e1bd73a5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:59.255267 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f6f79d42-a049-4f7c-9149-6385e1bd73a5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:59.256073 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f6f79d42-a049-4f7c-9149-6385e1bd73a5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:26:59.256515 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f6f79d42-a049-4f7c-9149-6385e1bd73a5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:26:59.395641 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f6f79d42-a049-4f7c-9149-6385e1bd73a5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:26:59.404034 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f6f79d42-a049-4f7c-9149-6385e1bd73a5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.160292 May 28 17:26:59.404703 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 108/227] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:26:59 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:27:00.270292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b3020b49-f47b-4912-90e0-7317ccfee9f6 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:00.270905 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b3020b49-f47b-4912-90e0-7317ccfee9f6 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:00.278045 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b3020b49-f47b-4912-90e0-7317ccfee9f6 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:00.278492 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b3020b49-f47b-4912-90e0-7317ccfee9f6 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:00.279251 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b3020b49-f47b-4912-90e0-7317ccfee9f6 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:00.279709 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b3020b49-f47b-4912-90e0-7317ccfee9f6 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:00.405356 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b3020b49-f47b-4912-90e0-7317ccfee9f6 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:00.413198 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b3020b49-f47b-4912-90e0-7317ccfee9f6 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1555 microversion: 2.1 time: 0.146729 May 28 17:27:00.413767 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 120/228] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:00 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1555 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:00.421606 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-69aee647-8f4f-4dea-90b5-f5c72f80e461 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:00.422304 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-69aee647-8f4f-4dea-90b5-f5c72f80e461 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:00.428269 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-69aee647-8f4f-4dea-90b5-f5c72f80e461 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:00.428716 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-69aee647-8f4f-4dea-90b5-f5c72f80e461 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:00.429473 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-69aee647-8f4f-4dea-90b5-f5c72f80e461 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:00.429905 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-69aee647-8f4f-4dea-90b5-f5c72f80e461 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:00.563255 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-69aee647-8f4f-4dea-90b5-f5c72f80e461 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:00.570633 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-69aee647-8f4f-4dea-90b5-f5c72f80e461 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.153560 May 28 17:27:00.571194 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 109/229] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:00 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:01.430454 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3c7e8b79-bdce-4758-8a6e-f66058fe1031 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:01.431271 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3c7e8b79-bdce-4758-8a6e-f66058fe1031 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:01.439952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3c7e8b79-bdce-4758-8a6e-f66058fe1031 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:01.440748 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3c7e8b79-bdce-4758-8a6e-f66058fe1031 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:01.441781 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3c7e8b79-bdce-4758-8a6e-f66058fe1031 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:01.442440 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3c7e8b79-bdce-4758-8a6e-f66058fe1031 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:01.490041 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-cf09431d-907c-45bd-bb47-ef4763fe8009 req-7d2bab42-c07e-4a4c-ab42-a19d0b12de5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3425b63d-c751-49bf-b2d9-0568c8cdae34", "name": "network-vif-unplugged", "status": "completed", "tag": "484051b7-f005-48d0-a799-a12b167c29db"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:27:01.501726 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-cf09431d-907c-45bd-bb47-ef4763fe8009 req-7d2bab42-c07e-4a4c-ab42-a19d0b12de5b service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:01.502171 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-cf09431d-907c-45bd-bb47-ef4763fe8009 req-7d2bab42-c07e-4a4c-ab42-a19d0b12de5b service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:01.516749 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-cf09431d-907c-45bd-bb47-ef4763fe8009 req-7d2bab42-c07e-4a4c-ab42-a19d0b12de5b service nova] Creating event network-vif-unplugged:484051b7-f005-48d0-a799-a12b167c29db for instance 3425b63d-c751-49bf-b2d9-0568c8cdae34 on hv-cinder-84372 May 28 17:27:01.522517 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-cf09431d-907c-45bd-bb47-ef4763fe8009 req-7d2bab42-c07e-4a4c-ab42-a19d0b12de5b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043873 May 28 17:27:01.523860 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 110/230] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:27:01.588470 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-624f1d9d-0418-45d9-8a0d-b32941861829 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:01.589758 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-624f1d9d-0418-45d9-8a0d-b32941861829 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:01.596043 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-624f1d9d-0418-45d9-8a0d-b32941861829 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:01.596520 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-624f1d9d-0418-45d9-8a0d-b32941861829 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:01.597289 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-624f1d9d-0418-45d9-8a0d-b32941861829 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:01.597734 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-624f1d9d-0418-45d9-8a0d-b32941861829 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:01.641378 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-3c7e8b79-bdce-4758-8a6e-f66058fe1031 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:01.651578 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3c7e8b79-bdce-4758-8a6e-f66058fe1031 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1555 microversion: 2.1 time: 0.225255 May 28 17:27:01.652400 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 121/231] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:01 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1555 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:01.880991 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-624f1d9d-0418-45d9-8a0d-b32941861829 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:01.889677 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-624f1d9d-0418-45d9-8a0d-b32941861829 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.305302 May 28 17:27:01.899187 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 111/232] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:01 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:27:02.314286 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-83307296-0269-4596-b869-df6627832098 req-d5152877-736d-4ed4-b3c7-119122a32af7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3425b63d-c751-49bf-b2d9-0568c8cdae34", "name": "network-vif-deleted", "tag": "484051b7-f005-48d0-a799-a12b167c29db"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:27:02.322405 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-83307296-0269-4596-b869-df6627832098 req-d5152877-736d-4ed4-b3c7-119122a32af7 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:02.322848 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-83307296-0269-4596-b869-df6627832098 req-d5152877-736d-4ed4-b3c7-119122a32af7 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:02.335670 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-83307296-0269-4596-b869-df6627832098 req-d5152877-736d-4ed4-b3c7-119122a32af7 service nova] Creating event network-vif-deleted:484051b7-f005-48d0-a799-a12b167c29db for instance 3425b63d-c751-49bf-b2d9-0568c8cdae34 on hv-cinder-84372 May 28 17:27:02.341431 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-83307296-0269-4596-b869-df6627832098 req-d5152877-736d-4ed4-b3c7-119122a32af7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030798 May 28 17:27:02.342096 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 122/233] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:27:02.670256 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-28d43285-4db1-4a8f-acd3-d3e0c0ae966b tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:02.671377 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-28d43285-4db1-4a8f-acd3-d3e0c0ae966b tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:02.677633 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-28d43285-4db1-4a8f-acd3-d3e0c0ae966b tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:02.678101 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-28d43285-4db1-4a8f-acd3-d3e0c0ae966b tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:02.678870 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-28d43285-4db1-4a8f-acd3-d3e0c0ae966b tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:02.679318 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-28d43285-4db1-4a8f-acd3-d3e0c0ae966b tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:02.743940 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-28d43285-4db1-4a8f-acd3-d3e0c0ae966b tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:02.752081 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-28d43285-4db1-4a8f-acd3-d3e0c0ae966b tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1346 microversion: 2.1 time: 0.086751 May 28 17:27:02.752640 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 112/234] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:02 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:02.907461 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b6b7911b-d94a-4671-bd70-036ebdbf211e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:02.908179 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b6b7911b-d94a-4671-bd70-036ebdbf211e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:02.914372 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b6b7911b-d94a-4671-bd70-036ebdbf211e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:02.914814 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b6b7911b-d94a-4671-bd70-036ebdbf211e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:02.915594 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b6b7911b-d94a-4671-bd70-036ebdbf211e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:02.916030 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b6b7911b-d94a-4671-bd70-036ebdbf211e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:03.048567 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b6b7911b-d94a-4671-bd70-036ebdbf211e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:03.056071 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b6b7911b-d94a-4671-bd70-036ebdbf211e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.153353 May 28 17:27:03.056639 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 123/235] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:02 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:03.769721 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6895c66f-19d9-448c-8706-b997d53d07c8 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:03.770315 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6895c66f-19d9-448c-8706-b997d53d07c8 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:03.777022 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6895c66f-19d9-448c-8706-b997d53d07c8 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:03.777486 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6895c66f-19d9-448c-8706-b997d53d07c8 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:03.778268 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6895c66f-19d9-448c-8706-b997d53d07c8 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:03.778703 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6895c66f-19d9-448c-8706-b997d53d07c8 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:03.842838 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-6895c66f-19d9-448c-8706-b997d53d07c8 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:03.851048 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6895c66f-19d9-448c-8706-b997d53d07c8 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1346 microversion: 2.1 time: 0.085082 May 28 17:27:03.851660 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 113/236] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:03 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:04.074843 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0f8ab302-cf73-47cd-b5b3-aef584d5b0d4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:04.075488 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0f8ab302-cf73-47cd-b5b3-aef584d5b0d4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:04.081922 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0f8ab302-cf73-47cd-b5b3-aef584d5b0d4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:04.082364 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0f8ab302-cf73-47cd-b5b3-aef584d5b0d4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:04.083121 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0f8ab302-cf73-47cd-b5b3-aef584d5b0d4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:04.083583 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0f8ab302-cf73-47cd-b5b3-aef584d5b0d4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:04.218438 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0f8ab302-cf73-47cd-b5b3-aef584d5b0d4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:04.226035 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0f8ab302-cf73-47cd-b5b3-aef584d5b0d4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.156127 May 28 17:27:04.236917 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 124/237] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:04 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:04.880805 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-412331cc-a020-4889-ad3e-b43c89833538 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:04.881942 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-412331cc-a020-4889-ad3e-b43c89833538 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:04.889204 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-412331cc-a020-4889-ad3e-b43c89833538 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:04.889897 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-412331cc-a020-4889-ad3e-b43c89833538 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:04.890508 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-412331cc-a020-4889-ad3e-b43c89833538 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:04.891118 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-412331cc-a020-4889-ad3e-b43c89833538 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:04.955470 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-412331cc-a020-4889-ad3e-b43c89833538 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:04.956817 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-412331cc-a020-4889-ad3e-b43c89833538 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:04.957422 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-412331cc-a020-4889-ad3e-b43c89833538 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lazy-loading 'fault' on Instance uuid 3425b63d-c751-49bf-b2d9-0568c8cdae34 {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 17:27:05.212502 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-412331cc-a020-4889-ad3e-b43c89833538 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21616bf7b5c44e6ad6a8c4a9cc6d8af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a433429eb484bd4b1dae47092f38c2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:05.219179 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-412331cc-a020-4889-ad3e-b43c89833538 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 200 len: 1305 microversion: 2.1 time: 0.342539 May 28 17:27:05.219783 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 114/238] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:04 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 1305 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:05.243642 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-157f21f5-1c16-4f5c-93b7-590f5813fed9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:05.244323 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-157f21f5-1c16-4f5c-93b7-590f5813fed9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:05.252162 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-157f21f5-1c16-4f5c-93b7-590f5813fed9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:05.252609 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-157f21f5-1c16-4f5c-93b7-590f5813fed9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:05.253361 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-157f21f5-1c16-4f5c-93b7-590f5813fed9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:05.253788 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-157f21f5-1c16-4f5c-93b7-590f5813fed9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:05.387589 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-157f21f5-1c16-4f5c-93b7-590f5813fed9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:05.394852 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-157f21f5-1c16-4f5c-93b7-590f5813fed9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.155144 May 28 17:27:05.395456 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 125/239] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:05 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:06.236596 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-bc373683-dd34-4de1-9d9d-ebf6ba083f22 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:06.237389 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-bc373683-dd34-4de1-9d9d-ebf6ba083f22 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:06.244143 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bc373683-dd34-4de1-9d9d-ebf6ba083f22 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:06.244614 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bc373683-dd34-4de1-9d9d-ebf6ba083f22 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:06.245384 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bc373683-dd34-4de1-9d9d-ebf6ba083f22 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:06.246130 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bc373683-dd34-4de1-9d9d-ebf6ba083f22 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:06.270116 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-bc373683-dd34-4de1-9d9d-ebf6ba083f22 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] HTTP exception thrown: Instance 3425b63d-c751-49bf-b2d9-0568c8cdae34 could not be found. May 28 17:27:06.274995 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-bc373683-dd34-4de1-9d9d-ebf6ba083f22 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Request method failure captured: May 28 17:27:06.274995 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 HTTP/1.1 May 28 17:27:06.274995 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept: application/json May 28 17:27:06.274995 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity May 28 17:27:06.274995 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Connection: close May 28 17:27:06.274995 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Length: 0 May 28 17:27:06.274995 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Type: application/json May 28 17:27:06.274995 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 May 28 17:27:06.274995 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None May 28 17:27:06.274995 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 May 28 17:27:06.274995 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABiklsFdNi2yegRNh2BvlQYRAof0MVWSOkr0FmWo0Mhskil_jZKBWKDSdB8oIv1ZTqt1I3sgzNpA0K03ltI82mHE6SQyg_ZXd3TKLuxqNKcGDcd7jRS3eUMgkob66pCzo1WZOOetY5jsjMfmPiaOZOdJYcFh1K3uvStBLsia7Vm974PxFA May 28 17:27:06.274995 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Id: None May 28 17:27:06.274995 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Name: None May 28 17:27:06.274995 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed May 28 17:27:06.274995 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True May 28 17:27:06.274995 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default May 28 17:27:06.274995 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default May 28 17:27:06.274995 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Id: 1a433429eb484bd4b1dae47092f38c2a May 28 17:27:06.274995 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-DeleteServersTestJSON-420937626 May 28 17:27:06.274995 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Role: reader,member May 28 17:27:06.274995 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Roles: reader,member May 28 17:27:06.276289 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a433429eb484bd4b1dae47092f38c2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a433429eb484bd4b1dae47092f38c2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1a433429eb484bd4b1dae47092f38c2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1a433429eb484bd4b1dae47092f38c2a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:27:06.276289 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-DeleteServersTestJSON-420937626 May 28 17:27:06.276289 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 1a433429eb484bd4b1dae47092f38c2a May 28 17:27:06.276289 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-DeleteServersTestJSON-420937626 May 28 17:27:06.276289 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User: tempest-DeleteServersTestJSON-420937626-project May 28 17:27:06.276289 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default May 28 17:27:06.276289 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default May 28 17:27:06.276289 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Id: e21616bf7b5c44e6ad6a8c4a9cc6d8af May 28 17:27:06.276289 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-DeleteServersTestJSON-420937626-project May 28 17:27:06.276289 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: method: > May 28 17:27:06.276289 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: exception: Instance 3425b63d-c751-49bf-b2d9-0568c8cdae34 could not be found. May 28 17:27:06.276289 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: action_args: {'id': '3425b63d-c751-49bf-b2d9-0568c8cdae34'} May 28 17:27:06.276988 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:27:06.276988 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:27:06.276988 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:27:06.276988 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:27:06.276988 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:27:06.276988 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:27:06.276988 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:27:06.276988 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:27:06.276988 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:27:06.276988 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:27:06.276988 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3425b63d-c751-49bf-b2d9-0568c8cdae34 could not be found. May 28 17:27:06.276988 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:27:06.276988 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:27:06.276988 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:27:06.276988 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:27:06.276988 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:27:06.276988 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:27:06.276988 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:27:06.276988 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:27:06.276988 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:27:06.278080 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:27:06.278080 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:27:06.278080 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:27:06.278080 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:27:06.278080 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:27:06.278080 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:27:06.278080 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:27:06.278080 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3425b63d-c751-49bf-b2d9-0568c8cdae34 could not be found. May 28 17:27:06.278080 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:27:06.278080 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:27:06.278080 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:27:06.278080 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:27:06.278080 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:27:06.278080 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:27:06.278080 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:27:06.278080 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:27:06.278080 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3425b63d-c751-49bf-b2d9-0568c8cdae34 could not be found. May 28 17:27:06.278080 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:27:06.280510 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-bc373683-dd34-4de1-9d9d-ebf6ba083f22 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Returning 404 to user: Instance 3425b63d-c751-49bf-b2d9-0568c8cdae34 could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:27:06.281478 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-bc373683-dd34-4de1-9d9d-ebf6ba083f22 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 404 len: 111 microversion: 2.1 time: 0.049474 May 28 17:27:06.282380 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 115/240] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:06 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:27:06.398604 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e22bf5b2-5626-4d58-bd1e-53ad2728c929 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:06.399749 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e22bf5b2-5626-4d58-bd1e-53ad2728c929 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:06.407998 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e22bf5b2-5626-4d58-bd1e-53ad2728c929 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:06.407998 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e22bf5b2-5626-4d58-bd1e-53ad2728c929 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:06.424290 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9369b230-1d7c-453a-bdc1-0dedaa0861fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:06.424954 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9369b230-1d7c-453a-bdc1-0dedaa0861fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:06.428750 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e22bf5b2-5626-4d58-bd1e-53ad2728c929 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:06.429190 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e22bf5b2-5626-4d58-bd1e-53ad2728c929 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:06.437121 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9369b230-1d7c-453a-bdc1-0dedaa0861fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:06.437570 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9369b230-1d7c-453a-bdc1-0dedaa0861fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:06.438342 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9369b230-1d7c-453a-bdc1-0dedaa0861fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:06.439447 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9369b230-1d7c-453a-bdc1-0dedaa0861fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:06.461522 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-e22bf5b2-5626-4d58-bd1e-53ad2728c929 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] HTTP exception thrown: Instance 3425b63d-c751-49bf-b2d9-0568c8cdae34 could not be found. May 28 17:27:06.467292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e22bf5b2-5626-4d58-bd1e-53ad2728c929 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Request method failure captured: May 28 17:27:06.467292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34/os-volume_attachments HTTP/1.1 May 28 17:27:06.467292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:27:06.467292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:27:06.467292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:27:06.467292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 0 May 28 17:27:06.467292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:27:06.467292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:27:06.467292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:27:06.467292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:27:06.467292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABiklsFdNi2yegRNh2BvlQYRAof0MVWSOkr0FmWo0Mhskil_jZKBWKDSdB8oIv1ZTqt1I3sgzNpA0K03ltI82mHE6SQyg_ZXd3TKLuxqNKcGDcd7jRS3eUMgkob66pCzo1WZOOetY5jsjMfmPiaOZOdJYcFh1K3uvStBLsia7Vm974PxFA May 28 17:27:06.467292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:27:06.467292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:27:06.467292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:27:06.467292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:27:06.467292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:27:06.467292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:27:06.467292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: 1a433429eb484bd4b1dae47092f38c2a May 28 17:27:06.467292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-DeleteServersTestJSON-420937626 May 28 17:27:06.467292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:27:06.467292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:27:06.468544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a433429eb484bd4b1dae47092f38c2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a433429eb484bd4b1dae47092f38c2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1a433429eb484bd4b1dae47092f38c2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1a433429eb484bd4b1dae47092f38c2a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:27:06.468544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-DeleteServersTestJSON-420937626 May 28 17:27:06.468544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 1a433429eb484bd4b1dae47092f38c2a May 28 17:27:06.468544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-DeleteServersTestJSON-420937626 May 28 17:27:06.468544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-DeleteServersTestJSON-420937626-project May 28 17:27:06.468544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:27:06.468544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:27:06.468544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: e21616bf7b5c44e6ad6a8c4a9cc6d8af May 28 17:27:06.468544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-DeleteServersTestJSON-420937626-project May 28 17:27:06.468544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: > May 28 17:27:06.468544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Instance 3425b63d-c751-49bf-b2d9-0568c8cdae34 could not be found. May 28 17:27:06.468544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'server_id': '3425b63d-c751-49bf-b2d9-0568c8cdae34'} May 28 17:27:06.469202 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:27:06.469202 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:27:06.469202 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:27:06.469202 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:27:06.469202 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:27:06.469202 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:27:06.469202 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:27:06.469202 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:27:06.469202 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:27:06.469202 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:27:06.469202 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3425b63d-c751-49bf-b2d9-0568c8cdae34 could not be found. May 28 17:27:06.469202 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:27:06.469202 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:27:06.469202 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:27:06.469202 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:27:06.469202 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:27:06.469202 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:27:06.469202 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:27:06.469202 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:27:06.469202 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:27:06.470361 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:27:06.470361 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 17:27:06.470361 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 17:27:06.470361 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 17:27:06.470361 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 17:27:06.470361 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 28 17:27:06.470361 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 28 17:27:06.470361 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:27:06.470361 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:27:06.470361 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3425b63d-c751-49bf-b2d9-0568c8cdae34 could not be found. May 28 17:27:06.470361 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:27:06.470361 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:27:06.470361 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:27:06.470361 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:27:06.470361 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:27:06.470361 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:27:06.470361 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:27:06.470361 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:27:06.470361 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3425b63d-c751-49bf-b2d9-0568c8cdae34 could not be found. May 28 17:27:06.470361 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:27:06.471473 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e22bf5b2-5626-4d58-bd1e-53ad2728c929 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Returning 404 to user: Instance 3425b63d-c751-49bf-b2d9-0568c8cdae34 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:27:06.471473 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e22bf5b2-5626-4d58-bd1e-53ad2728c929 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.076186 May 28 17:27:06.473710 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 126/241] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 17:27:06 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34/os-volume_attachments => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:27:06.623659 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-9369b230-1d7c-453a-bdc1-0dedaa0861fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:06.631612 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9369b230-1d7c-453a-bdc1-0dedaa0861fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.222273 May 28 17:27:06.632194 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 116/242] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:06 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:27:07.649134 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f849a361-7595-4909-8ca2-03ba3566b02c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:07.649731 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f849a361-7595-4909-8ca2-03ba3566b02c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:07.652327 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:27:07.659180 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f849a361-7595-4909-8ca2-03ba3566b02c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:07.659866 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f849a361-7595-4909-8ca2-03ba3566b02c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:07.661052 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f849a361-7595-4909-8ca2-03ba3566b02c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:07.661755 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f849a361-7595-4909-8ca2-03ba3566b02c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:07.806569 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f849a361-7595-4909-8ca2-03ba3566b02c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:07.808609 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f849a361-7595-4909-8ca2-03ba3566b02c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.163289 May 28 17:27:07.809184 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 127/243] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:07 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:08.794587 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-cc4816a9-0193-4ce3-a270-364251ab4ab8 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:08.795721 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-cc4816a9-0193-4ce3-a270-364251ab4ab8 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:08.801729 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cc4816a9-0193-4ce3-a270-364251ab4ab8 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:08.802180 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cc4816a9-0193-4ce3-a270-364251ab4ab8 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:08.802990 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cc4816a9-0193-4ce3-a270-364251ab4ab8 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:08.803461 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cc4816a9-0193-4ce3-a270-364251ab4ab8 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:08.818016 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-cc4816a9-0193-4ce3-a270-364251ab4ab8 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] HTTP exception thrown: Instance 3425b63d-c751-49bf-b2d9-0568c8cdae34 could not be found. May 28 17:27:08.820564 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-cc4816a9-0193-4ce3-a270-364251ab4ab8 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Request method failure captured: May 28 17:27:08.820564 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: request: DELETE /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 HTTP/1.1 May 28 17:27:08.820564 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept: application/json May 28 17:27:08.820564 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity May 28 17:27:08.820564 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Connection: close May 28 17:27:08.820564 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Length: 0 May 28 17:27:08.820564 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Type: application/json May 28 17:27:08.820564 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 May 28 17:27:08.820564 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None May 28 17:27:08.820564 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 May 28 17:27:08.820564 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABiklsFdNi2yegRNh2BvlQYRAof0MVWSOkr0FmWo0Mhskil_jZKBWKDSdB8oIv1ZTqt1I3sgzNpA0K03ltI82mHE6SQyg_ZXd3TKLuxqNKcGDcd7jRS3eUMgkob66pCzo1WZOOetY5jsjMfmPiaOZOdJYcFh1K3uvStBLsia7Vm974PxFA May 28 17:27:08.820564 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Id: None May 28 17:27:08.820564 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Name: None May 28 17:27:08.820564 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed May 28 17:27:08.820564 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True May 28 17:27:08.820564 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default May 28 17:27:08.820564 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default May 28 17:27:08.820564 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Id: 1a433429eb484bd4b1dae47092f38c2a May 28 17:27:08.820564 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-DeleteServersTestJSON-420937626 May 28 17:27:08.820564 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Role: reader,member May 28 17:27:08.820564 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Roles: reader,member May 28 17:27:08.821861 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a433429eb484bd4b1dae47092f38c2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a433429eb484bd4b1dae47092f38c2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1a433429eb484bd4b1dae47092f38c2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1a433429eb484bd4b1dae47092f38c2a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:27:08.821861 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-DeleteServersTestJSON-420937626 May 28 17:27:08.821861 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 1a433429eb484bd4b1dae47092f38c2a May 28 17:27:08.821861 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-DeleteServersTestJSON-420937626 May 28 17:27:08.821861 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User: tempest-DeleteServersTestJSON-420937626-project May 28 17:27:08.821861 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default May 28 17:27:08.821861 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default May 28 17:27:08.821861 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Id: e21616bf7b5c44e6ad6a8c4a9cc6d8af May 28 17:27:08.821861 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-DeleteServersTestJSON-420937626-project May 28 17:27:08.821861 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: method: > May 28 17:27:08.821861 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: exception: Instance 3425b63d-c751-49bf-b2d9-0568c8cdae34 could not be found. May 28 17:27:08.821861 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: action_args: {'id': '3425b63d-c751-49bf-b2d9-0568c8cdae34'} May 28 17:27:08.822515 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:27:08.822515 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:27:08.822515 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:27:08.822515 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:27:08.822515 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:27:08.822515 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:27:08.822515 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:27:08.822515 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:27:08.822515 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:27:08.822515 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:27:08.822515 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3425b63d-c751-49bf-b2d9-0568c8cdae34 could not be found. May 28 17:27:08.822515 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:27:08.822515 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:27:08.822515 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:27:08.822515 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:27:08.822515 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:27:08.822515 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:27:08.822515 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:27:08.822515 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:27:08.822515 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:27:08.823614 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:27:08.823614 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 17:27:08.823614 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 17:27:08.823614 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 17:27:08.823614 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 17:27:08.823614 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:27:08.823614 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:27:08.823614 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:27:08.823614 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:27:08.823614 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3425b63d-c751-49bf-b2d9-0568c8cdae34 could not be found. May 28 17:27:08.823614 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:27:08.823614 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:27:08.823614 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:27:08.823614 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:27:08.823614 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:27:08.823614 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:27:08.823614 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:27:08.823614 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:27:08.823614 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3425b63d-c751-49bf-b2d9-0568c8cdae34 could not be found. May 28 17:27:08.823614 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:27:08.824680 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-cc4816a9-0193-4ce3-a270-364251ab4ab8 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Returning 404 to user: Instance 3425b63d-c751-49bf-b2d9-0568c8cdae34 could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:27:08.824680 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-cc4816a9-0193-4ce3-a270-364251ab4ab8 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 404 len: 111 microversion: 2.1 time: 0.031217 May 28 17:27:08.824680 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 117/244] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 17:27:08 2022] DELETE /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:27:08.830679 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-03e4a9b3-6609-465d-aa33-16cd4cb634f2 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:08.830921 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8e0410d8-09eb-4521-9241-b98883da0447 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:08.831379 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-03e4a9b3-6609-465d-aa33-16cd4cb634f2 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] [instance: 3425b63d-c751-49bf-b2d9-0568c8cdae34] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:08.831575 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8e0410d8-09eb-4521-9241-b98883da0447 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:08.837374 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-03e4a9b3-6609-465d-aa33-16cd4cb634f2 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:08.837835 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-03e4a9b3-6609-465d-aa33-16cd4cb634f2 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:08.838034 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8e0410d8-09eb-4521-9241-b98883da0447 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:08.838569 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-03e4a9b3-6609-465d-aa33-16cd4cb634f2 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:08.838674 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8e0410d8-09eb-4521-9241-b98883da0447 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:08.839106 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-03e4a9b3-6609-465d-aa33-16cd4cb634f2 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:08.839435 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8e0410d8-09eb-4521-9241-b98883da0447 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:08.839878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8e0410d8-09eb-4521-9241-b98883da0447 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:08.853088 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-03e4a9b3-6609-465d-aa33-16cd4cb634f2 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] HTTP exception thrown: Instance 3425b63d-c751-49bf-b2d9-0568c8cdae34 could not be found. May 28 17:27:08.854606 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-03e4a9b3-6609-465d-aa33-16cd4cb634f2 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Request method failure captured: May 28 17:27:08.854606 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 HTTP/1.1 May 28 17:27:08.854606 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept: application/json May 28 17:27:08.854606 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity May 28 17:27:08.854606 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Connection: close May 28 17:27:08.854606 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Length: 0 May 28 17:27:08.854606 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Type: application/json May 28 17:27:08.854606 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 May 28 17:27:08.854606 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None May 28 17:27:08.854606 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 May 28 17:27:08.854606 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABiklsFdNi2yegRNh2BvlQYRAof0MVWSOkr0FmWo0Mhskil_jZKBWKDSdB8oIv1ZTqt1I3sgzNpA0K03ltI82mHE6SQyg_ZXd3TKLuxqNKcGDcd7jRS3eUMgkob66pCzo1WZOOetY5jsjMfmPiaOZOdJYcFh1K3uvStBLsia7Vm974PxFA May 28 17:27:08.854606 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Id: None May 28 17:27:08.854606 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Name: None May 28 17:27:08.854606 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed May 28 17:27:08.854606 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True May 28 17:27:08.854606 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default May 28 17:27:08.854606 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default May 28 17:27:08.854606 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Id: 1a433429eb484bd4b1dae47092f38c2a May 28 17:27:08.854606 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-DeleteServersTestJSON-420937626 May 28 17:27:08.854606 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Role: reader,member May 28 17:27:08.854606 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Roles: reader,member May 28 17:27:08.855903 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a433429eb484bd4b1dae47092f38c2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1a433429eb484bd4b1dae47092f38c2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1a433429eb484bd4b1dae47092f38c2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1a433429eb484bd4b1dae47092f38c2a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:27:08.855903 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-DeleteServersTestJSON-420937626 May 28 17:27:08.855903 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 1a433429eb484bd4b1dae47092f38c2a May 28 17:27:08.855903 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-DeleteServersTestJSON-420937626 May 28 17:27:08.855903 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User: tempest-DeleteServersTestJSON-420937626-project May 28 17:27:08.855903 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default May 28 17:27:08.855903 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default May 28 17:27:08.855903 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Id: e21616bf7b5c44e6ad6a8c4a9cc6d8af May 28 17:27:08.855903 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-DeleteServersTestJSON-420937626-project May 28 17:27:08.855903 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: method: > May 28 17:27:08.855903 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: exception: Instance 3425b63d-c751-49bf-b2d9-0568c8cdae34 could not be found. May 28 17:27:08.855903 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: action_args: {'id': '3425b63d-c751-49bf-b2d9-0568c8cdae34'} May 28 17:27:08.859527 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:27:08.859527 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:27:08.859527 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:27:08.859527 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:27:08.859527 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:27:08.859527 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:27:08.859527 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:27:08.859527 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:27:08.859527 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:27:08.859527 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:27:08.859527 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3425b63d-c751-49bf-b2d9-0568c8cdae34 could not be found. May 28 17:27:08.859527 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:27:08.859527 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:27:08.859527 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:27:08.859527 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:27:08.859527 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:27:08.859527 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:27:08.859527 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:27:08.859527 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:27:08.859527 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:27:08.861081 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:27:08.861081 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:27:08.861081 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:27:08.861081 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:27:08.861081 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:27:08.861081 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:27:08.861081 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:27:08.861081 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3425b63d-c751-49bf-b2d9-0568c8cdae34 could not be found. May 28 17:27:08.861081 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:27:08.861081 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:27:08.861081 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:27:08.861081 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:27:08.861081 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:27:08.861081 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:27:08.861081 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:27:08.861081 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:27:08.861081 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3425b63d-c751-49bf-b2d9-0568c8cdae34 could not be found. May 28 17:27:08.861081 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:27:08.862270 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-03e4a9b3-6609-465d-aa33-16cd4cb634f2 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] Returning 404 to user: Instance 3425b63d-c751-49bf-b2d9-0568c8cdae34 could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:27:08.862270 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-03e4a9b3-6609-465d-aa33-16cd4cb634f2 tempest-DeleteServersTestJSON-420937626 tempest-DeleteServersTestJSON-420937626-project] 10.222.0.33 "GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34" status: 404 len: 111 microversion: 2.1 time: 0.029673 May 28 17:27:08.862270 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 118/245] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:08 2022] GET /compute/v2.1/servers/3425b63d-c751-49bf-b2d9-0568c8cdae34 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:27:08.992458 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8e0410d8-09eb-4521-9241-b98883da0447 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:09.000779 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8e0410d8-09eb-4521-9241-b98883da0447 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.174607 May 28 17:27:09.001349 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 128/246] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:08 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:10.018304 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-00701cc9-4963-4cdc-a0cb-96b645bc62e9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:10.018891 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-00701cc9-4963-4cdc-a0cb-96b645bc62e9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:10.025367 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-00701cc9-4963-4cdc-a0cb-96b645bc62e9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:10.025713 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-00701cc9-4963-4cdc-a0cb-96b645bc62e9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:10.026609 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-00701cc9-4963-4cdc-a0cb-96b645bc62e9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:10.027050 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-00701cc9-4963-4cdc-a0cb-96b645bc62e9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:10.181240 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-00701cc9-4963-4cdc-a0cb-96b645bc62e9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:10.190645 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-00701cc9-4963-4cdc-a0cb-96b645bc62e9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.177065 May 28 17:27:10.191564 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 119/247] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:10 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:11.207135 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f3be92f6-770f-4277-94b2-ff3ca347ff59 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:11.208127 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f3be92f6-770f-4277-94b2-ff3ca347ff59 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:11.215149 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f3be92f6-770f-4277-94b2-ff3ca347ff59 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:11.215725 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f3be92f6-770f-4277-94b2-ff3ca347ff59 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:11.216624 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f3be92f6-770f-4277-94b2-ff3ca347ff59 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:11.217282 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f3be92f6-770f-4277-94b2-ff3ca347ff59 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:11.368622 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f3be92f6-770f-4277-94b2-ff3ca347ff59 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:11.381665 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f3be92f6-770f-4277-94b2-ff3ca347ff59 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.177800 May 28 17:27:11.383469 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 129/248] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:11 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:12.402229 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e08fd2d2-c5a7-4d97-b793-614c659e7e87 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:12.403859 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-e08fd2d2-c5a7-4d97-b793-614c659e7e87 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:12.412765 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e08fd2d2-c5a7-4d97-b793-614c659e7e87 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:12.413788 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e08fd2d2-c5a7-4d97-b793-614c659e7e87 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:12.415453 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e08fd2d2-c5a7-4d97-b793-614c659e7e87 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:12.416925 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e08fd2d2-c5a7-4d97-b793-614c659e7e87 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:12.444806 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:27:12.693301 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-e08fd2d2-c5a7-4d97-b793-614c659e7e87 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:12.701089 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-e08fd2d2-c5a7-4d97-b793-614c659e7e87 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.304261 May 28 17:27:12.710971 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 120/249] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:12 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:13.718943 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ea80d2f2-d1ae-491e-835e-bcc8a765ca9a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:13.719722 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ea80d2f2-d1ae-491e-835e-bcc8a765ca9a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:13.727478 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ea80d2f2-d1ae-491e-835e-bcc8a765ca9a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:13.728215 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ea80d2f2-d1ae-491e-835e-bcc8a765ca9a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:13.729336 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ea80d2f2-d1ae-491e-835e-bcc8a765ca9a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:13.730018 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ea80d2f2-d1ae-491e-835e-bcc8a765ca9a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:13.878773 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ea80d2f2-d1ae-491e-835e-bcc8a765ca9a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:13.887703 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ea80d2f2-d1ae-491e-835e-bcc8a765ca9a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.173273 May 28 17:27:13.889550 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 130/250] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:13 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:14.909953 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-bea21710-513e-4337-8bfe-373e7b7c9fa7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:14.911364 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-bea21710-513e-4337-8bfe-373e7b7c9fa7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:14.927716 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bea21710-513e-4337-8bfe-373e7b7c9fa7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:14.934166 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bea21710-513e-4337-8bfe-373e7b7c9fa7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:14.936403 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bea21710-513e-4337-8bfe-373e7b7c9fa7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:14.938112 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bea21710-513e-4337-8bfe-373e7b7c9fa7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:15.411127 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bea21710-513e-4337-8bfe-373e7b7c9fa7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:15.421798 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-bea21710-513e-4337-8bfe-373e7b7c9fa7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.519359 May 28 17:27:15.423990 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 121/251] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:14 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:16.451035 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c4ca3fb5-002a-4a17-95c2-dde5a3966169 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:16.452251 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c4ca3fb5-002a-4a17-95c2-dde5a3966169 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:16.458845 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c4ca3fb5-002a-4a17-95c2-dde5a3966169 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:16.471957 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c4ca3fb5-002a-4a17-95c2-dde5a3966169 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:16.473172 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c4ca3fb5-002a-4a17-95c2-dde5a3966169 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:16.473849 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c4ca3fb5-002a-4a17-95c2-dde5a3966169 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:16.814403 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c4ca3fb5-002a-4a17-95c2-dde5a3966169 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:16.829060 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c4ca3fb5-002a-4a17-95c2-dde5a3966169 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.391635 May 28 17:27:16.831211 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 131/252] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:16 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:17.319623 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-46ebc939-630c-40fb-80ba-032e3452774a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Action: 'create', calling method: .version_select at 0x7f9efc3e1ee0>, body: {"keypair": {"name": "tempest-keypair-1904964645", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ80VhVSkV+KpU42qhTBIgXE9nbr9wKMiVtXhRlpbhYK87yumOc+pUyVm8gv8Dfhfz8DacXgrnRDTuCupEOUupuUV1n8ERynLqQWoXL3mRB6VFzo0VXsmkm2p9nYmErwXw=="}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:27:17.338872 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-46ebc939-630c-40fb-80ba-032e3452774a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Getting quotas for project afaaf8bde7134efc80c77d707bb309bc. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:27:17.343488 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-46ebc939-630c-40fb-80ba-032e3452774a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Getting quotas for user 710b406ba65646ed94c3f9d356b161f1 and project afaaf8bde7134efc80c77d707bb309bc. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:27:17.374106 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-46ebc939-630c-40fb-80ba-032e3452774a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.271597 May 28 17:27:17.375289 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 122/253] 10.222.0.33 () {62 vars in 1199 bytes} [Sat May 28 17:27:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 276 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 28 17:27:17.847925 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-dc751b6a-a584-442e-8286-4b6778700cbd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:17.848622 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-dc751b6a-a584-442e-8286-4b6778700cbd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:17.855528 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dc751b6a-a584-442e-8286-4b6778700cbd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:17.856594 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dc751b6a-a584-442e-8286-4b6778700cbd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:17.858086 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dc751b6a-a584-442e-8286-4b6778700cbd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:17.858564 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dc751b6a-a584-442e-8286-4b6778700cbd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:18.082537 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-dc751b6a-a584-442e-8286-4b6778700cbd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:18.091213 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-dc751b6a-a584-442e-8286-4b6778700cbd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.247491 May 28 17:27:18.101399 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 132/254] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:17 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:19.113749 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6171b4c7-f657-4ef0-bbe9-b469ad5ac328 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:19.115163 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6171b4c7-f657-4ef0-bbe9-b469ad5ac328 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:19.133997 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6171b4c7-f657-4ef0-bbe9-b469ad5ac328 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:19.135491 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6171b4c7-f657-4ef0-bbe9-b469ad5ac328 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:19.137419 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6171b4c7-f657-4ef0-bbe9-b469ad5ac328 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:19.138120 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6171b4c7-f657-4ef0-bbe9-b469ad5ac328 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:19.345373 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-6171b4c7-f657-4ef0-bbe9-b469ad5ac328 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:19.356564 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6171b4c7-f657-4ef0-bbe9-b469ad5ac328 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.251571 May 28 17:27:19.358064 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 123/255] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:19 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:19.392120 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-87eb5eed-ed29-4c95-86ec-43a18fbcca1b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1149354731", "imageRef": "b2aab55c-a793-472a-bc32-81af689ad609", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9aa607a6-b193-4d84-be0c-e5c8f4a565d2"}], "security_groups": [{"name": "tempest-securitygroup--1452468175"}], "key_name": "tempest-keypair-1904964645", "user_data": "}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:27:20.375189 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0dc7d0d9-c431-41fa-afec-0870471d1ef2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:20.375840 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0dc7d0d9-c431-41fa-afec-0870471d1ef2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:20.385228 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0dc7d0d9-c431-41fa-afec-0870471d1ef2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:20.385892 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0dc7d0d9-c431-41fa-afec-0870471d1ef2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:20.386834 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0dc7d0d9-c431-41fa-afec-0870471d1ef2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:20.387492 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0dc7d0d9-c431-41fa-afec-0870471d1ef2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:20.573059 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0dc7d0d9-c431-41fa-afec-0870471d1ef2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:20.583576 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0dc7d0d9-c431-41fa-afec-0870471d1ef2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.212622 May 28 17:27:20.584149 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 124/256] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:20 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:21.602097 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8d206d6e-c29d-4805-be6a-473caf081453 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:21.603138 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8d206d6e-c29d-4805-be6a-473caf081453 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:21.613913 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8d206d6e-c29d-4805-be6a-473caf081453 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:21.614373 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8d206d6e-c29d-4805-be6a-473caf081453 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:21.615201 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8d206d6e-c29d-4805-be6a-473caf081453 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:21.615716 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8d206d6e-c29d-4805-be6a-473caf081453 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:21.865520 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8d206d6e-c29d-4805-be6a-473caf081453 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:21.876234 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8d206d6e-c29d-4805-be6a-473caf081453 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.279411 May 28 17:27:21.877703 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 125/257] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:21 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:27:22.900567 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-caef65bc-6f49-4630-8bb4-70909857a868 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:22.900567 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-caef65bc-6f49-4630-8bb4-70909857a868 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:22.911855 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-caef65bc-6f49-4630-8bb4-70909857a868 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:22.913152 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-caef65bc-6f49-4630-8bb4-70909857a868 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:22.916168 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-caef65bc-6f49-4630-8bb4-70909857a868 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:22.917277 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-caef65bc-6f49-4630-8bb4-70909857a868 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:23.096793 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-caef65bc-6f49-4630-8bb4-70909857a868 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:23.116337 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-caef65bc-6f49-4630-8bb4-70909857a868 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.222308 May 28 17:27:23.116930 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 126/258] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:22 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:27:24.135878 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d0da6c10-6cbe-4a31-a6a0-1da6f75a3aa1 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:24.137253 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d0da6c10-6cbe-4a31-a6a0-1da6f75a3aa1 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:24.145703 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d0da6c10-6cbe-4a31-a6a0-1da6f75a3aa1 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:24.146445 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d0da6c10-6cbe-4a31-a6a0-1da6f75a3aa1 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:24.147804 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d0da6c10-6cbe-4a31-a6a0-1da6f75a3aa1 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:24.148388 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d0da6c10-6cbe-4a31-a6a0-1da6f75a3aa1 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:24.345368 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.network.neutron [None req-87eb5eed-ed29-4c95-86ec-43a18fbcca1b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] validate_networks() for [('9aa607a6-b193-4d84-be0c-e5c8f4a565d2', None, None, None, None, None)] {{(pid=117604) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 17:27:24.426087 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d0da6c10-6cbe-4a31-a6a0-1da6f75a3aa1 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:24.439224 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d0da6c10-6cbe-4a31-a6a0-1da6f75a3aa1 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.308105 May 28 17:27:24.440501 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 127/259] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:24 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:25.106562 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-87eb5eed-ed29-4c95-86ec-43a18fbcca1b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Flavor limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 17:27:25.106995 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-87eb5eed-ed29-4c95-86ec-43a18fbcca1b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Image limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 17:27:25.107653 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-87eb5eed-ed29-4c95-86ec-43a18fbcca1b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Flavor pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 17:27:25.108578 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-87eb5eed-ed29-4c95-86ec-43a18fbcca1b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Image pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 17:27:25.109182 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-87eb5eed-ed29-4c95-86ec-43a18fbcca1b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 17:27:25.119592 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-87eb5eed-ed29-4c95-86ec-43a18fbcca1b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:25.120422 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-87eb5eed-ed29-4c95-86ec-43a18fbcca1b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:25.121838 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-87eb5eed-ed29-4c95-86ec-43a18fbcca1b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:25.122386 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-87eb5eed-ed29-4c95-86ec-43a18fbcca1b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:25.149811 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-87eb5eed-ed29-4c95-86ec-43a18fbcca1b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Getting quotas for project afaaf8bde7134efc80c77d707bb309bc. Resources: {'instances', 'cores', 'ram'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:27:25.154289 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-87eb5eed-ed29-4c95-86ec-43a18fbcca1b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Getting quotas for user 710b406ba65646ed94c3f9d356b161f1 and project afaaf8bde7134efc80c77d707bb309bc. Resources: {'instances', 'cores', 'ram'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:27:25.167626 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-87eb5eed-ed29-4c95-86ec-43a18fbcca1b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Going to run 1 instances... {{(pid=117604) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 17:27:25.170624 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-87eb5eed-ed29-4c95-86ec-43a18fbcca1b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b2aab55c-a793-472a-bc32-81af689ad609',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 17:27:25.226483 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-87eb5eed-ed29-4c95-86ec-43a18fbcca1b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.839419 May 28 17:27:25.227786 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 133/260] 10.222.0.33 () {62 vars in 1187 bytes} [Sat May 28 17:27:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 5841 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 17:27:25.240586 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f63ccbb6-f601-414c-a522-88f19fa4a95e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:25.244180 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f63ccbb6-f601-414c-a522-88f19fa4a95e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:25.381824 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f63ccbb6-f601-414c-a522-88f19fa4a95e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:25.392154 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f63ccbb6-f601-414c-a522-88f19fa4a95e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:25.393677 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f63ccbb6-f601-414c-a522-88f19fa4a95e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:25.394797 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f63ccbb6-f601-414c-a522-88f19fa4a95e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1282 microversion: 2.20 time: 0.160453 May 28 17:27:25.395722 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 128/261] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:27:25 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1282 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:27:25.457441 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a05491e1-e74a-4f5e-8bd4-47011ef8e405 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:25.458059 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a05491e1-e74a-4f5e-8bd4-47011ef8e405 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:25.464327 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a05491e1-e74a-4f5e-8bd4-47011ef8e405 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:25.464783 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a05491e1-e74a-4f5e-8bd4-47011ef8e405 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:25.465559 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a05491e1-e74a-4f5e-8bd4-47011ef8e405 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:25.471825 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a05491e1-e74a-4f5e-8bd4-47011ef8e405 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:25.695191 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a05491e1-e74a-4f5e-8bd4-47011ef8e405 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:25.709075 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a05491e1-e74a-4f5e-8bd4-47011ef8e405 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.255610 May 28 17:27:25.731098 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 134/262] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:25 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:26.415457 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-89b73c57-1e6b-4a00-810e-866c2c207169 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:26.416614 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-89b73c57-1e6b-4a00-810e-866c2c207169 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:26.423801 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-89b73c57-1e6b-4a00-810e-866c2c207169 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:26.424587 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-89b73c57-1e6b-4a00-810e-866c2c207169 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:26.425361 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-89b73c57-1e6b-4a00-810e-866c2c207169 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:26.433260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-89b73c57-1e6b-4a00-810e-866c2c207169 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:26.537576 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-89b73c57-1e6b-4a00-810e-866c2c207169 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:26.546514 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-89b73c57-1e6b-4a00-810e-866c2c207169 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:26.548345 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-89b73c57-1e6b-4a00-810e-866c2c207169 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:26.549543 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-89b73c57-1e6b-4a00-810e-866c2c207169 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1286 microversion: 2.20 time: 0.137889 May 28 17:27:26.550183 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 129/263] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:27:26 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1286 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:27:26.747635 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a58a7ffe-e4f6-4609-82ad-5db573bd383c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:26.749452 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a58a7ffe-e4f6-4609-82ad-5db573bd383c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:26.757566 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a58a7ffe-e4f6-4609-82ad-5db573bd383c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:26.758011 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a58a7ffe-e4f6-4609-82ad-5db573bd383c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:26.758801 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a58a7ffe-e4f6-4609-82ad-5db573bd383c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:26.759426 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a58a7ffe-e4f6-4609-82ad-5db573bd383c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:26.912485 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a58a7ffe-e4f6-4609-82ad-5db573bd383c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:26.921943 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a58a7ffe-e4f6-4609-82ad-5db573bd383c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.178457 May 28 17:27:26.922732 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 135/264] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:26 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:27:27.568312 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-de41c89f-b9d0-4de3-9bd5-2c27a1736a97 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:27.568933 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-de41c89f-b9d0-4de3-9bd5-2c27a1736a97 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:27.570865 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:27:27.576180 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-de41c89f-b9d0-4de3-9bd5-2c27a1736a97 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:27.576981 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-de41c89f-b9d0-4de3-9bd5-2c27a1736a97 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:27.578132 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-de41c89f-b9d0-4de3-9bd5-2c27a1736a97 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:27.578830 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-de41c89f-b9d0-4de3-9bd5-2c27a1736a97 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:27.646746 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-de41c89f-b9d0-4de3-9bd5-2c27a1736a97 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:27.655417 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-de41c89f-b9d0-4de3-9bd5-2c27a1736a97 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:27.656949 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-de41c89f-b9d0-4de3-9bd5-2c27a1736a97 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:27.658113 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-de41c89f-b9d0-4de3-9bd5-2c27a1736a97 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1286 microversion: 2.20 time: 0.093777 May 28 17:27:27.658675 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 130/265] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:27:27 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:27:27.939224 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-90a0638a-52ec-432a-aaa0-4b24f943f4fa tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:27.939867 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-90a0638a-52ec-432a-aaa0-4b24f943f4fa tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:27.946284 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-90a0638a-52ec-432a-aaa0-4b24f943f4fa tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:27.946735 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-90a0638a-52ec-432a-aaa0-4b24f943f4fa tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:27.947537 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-90a0638a-52ec-432a-aaa0-4b24f943f4fa tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:27.947976 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-90a0638a-52ec-432a-aaa0-4b24f943f4fa tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:28.107197 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-90a0638a-52ec-432a-aaa0-4b24f943f4fa tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:28.113008 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=97 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:27:28.127037 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-90a0638a-52ec-432a-aaa0-4b24f943f4fa tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.192123 May 28 17:27:28.142225 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 136/266] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:27 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:28.676541 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b9275781-baab-4d8c-96e2-eda2f5d55d97 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:28.677937 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-b9275781-baab-4d8c-96e2-eda2f5d55d97 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:28.686127 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b9275781-baab-4d8c-96e2-eda2f5d55d97 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:28.686539 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b9275781-baab-4d8c-96e2-eda2f5d55d97 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:28.687331 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b9275781-baab-4d8c-96e2-eda2f5d55d97 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:28.687956 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b9275781-baab-4d8c-96e2-eda2f5d55d97 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:28.777246 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b9275781-baab-4d8c-96e2-eda2f5d55d97 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:28.785442 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b9275781-baab-4d8c-96e2-eda2f5d55d97 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:28.787191 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b9275781-baab-4d8c-96e2-eda2f5d55d97 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:28.788560 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b9275781-baab-4d8c-96e2-eda2f5d55d97 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1286 microversion: 2.20 time: 0.116410 May 28 17:27:28.799576 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 131/267] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:27:28 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1286 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:27:29.150309 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-344906e9-8b46-45de-814e-1705c973cbbf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:29.151785 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-344906e9-8b46-45de-814e-1705c973cbbf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:29.160070 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-344906e9-8b46-45de-814e-1705c973cbbf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:29.160760 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-344906e9-8b46-45de-814e-1705c973cbbf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:29.161777 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-344906e9-8b46-45de-814e-1705c973cbbf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:29.162556 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-344906e9-8b46-45de-814e-1705c973cbbf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:29.316927 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-344906e9-8b46-45de-814e-1705c973cbbf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:29.324684 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-344906e9-8b46-45de-814e-1705c973cbbf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.178731 May 28 17:27:29.325565 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 137/268] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:29 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:29.806548 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-868f1bc6-6f72-4dbc-9fe9-9e327acd0ce5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:29.807256 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-868f1bc6-6f72-4dbc-9fe9-9e327acd0ce5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:29.814203 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-868f1bc6-6f72-4dbc-9fe9-9e327acd0ce5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:29.814856 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-868f1bc6-6f72-4dbc-9fe9-9e327acd0ce5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:29.815805 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-868f1bc6-6f72-4dbc-9fe9-9e327acd0ce5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:29.816365 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-868f1bc6-6f72-4dbc-9fe9-9e327acd0ce5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:29.889956 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-868f1bc6-6f72-4dbc-9fe9-9e327acd0ce5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:29.898916 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-868f1bc6-6f72-4dbc-9fe9-9e327acd0ce5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:29.908716 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-868f1bc6-6f72-4dbc-9fe9-9e327acd0ce5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:29.908716 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-868f1bc6-6f72-4dbc-9fe9-9e327acd0ce5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1286 microversion: 2.20 time: 0.105034 May 28 17:27:29.908716 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 132/269] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:27:29 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1286 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:27:30.345541 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9820580e-98b1-44a4-9b95-51987d0222f0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:30.346542 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9820580e-98b1-44a4-9b95-51987d0222f0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:30.356767 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9820580e-98b1-44a4-9b95-51987d0222f0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:30.358163 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9820580e-98b1-44a4-9b95-51987d0222f0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:30.359449 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9820580e-98b1-44a4-9b95-51987d0222f0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:30.360134 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9820580e-98b1-44a4-9b95-51987d0222f0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:30.515691 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9820580e-98b1-44a4-9b95-51987d0222f0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:30.530785 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9820580e-98b1-44a4-9b95-51987d0222f0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.192014 May 28 17:27:30.532859 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 138/270] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:30 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:27:30.926276 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3c90c73e-faab-4c0f-a6a2-d289462f9045 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:30.927611 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3c90c73e-faab-4c0f-a6a2-d289462f9045 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:30.935061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3c90c73e-faab-4c0f-a6a2-d289462f9045 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:30.936187 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3c90c73e-faab-4c0f-a6a2-d289462f9045 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:30.937007 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3c90c73e-faab-4c0f-a6a2-d289462f9045 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:30.938135 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3c90c73e-faab-4c0f-a6a2-d289462f9045 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:31.025896 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3c90c73e-faab-4c0f-a6a2-d289462f9045 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:31.038098 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3c90c73e-faab-4c0f-a6a2-d289462f9045 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:31.040145 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3c90c73e-faab-4c0f-a6a2-d289462f9045 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:31.043899 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3c90c73e-faab-4c0f-a6a2-d289462f9045 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1278 microversion: 2.20 time: 0.122711 May 28 17:27:31.047011 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 133/271] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:27:30 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1278 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:27:31.552773 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6c013b9e-2956-44b2-8f09-f11aa46a9cd8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:31.555782 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6c013b9e-2956-44b2-8f09-f11aa46a9cd8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:31.574646 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6c013b9e-2956-44b2-8f09-f11aa46a9cd8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:31.575365 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6c013b9e-2956-44b2-8f09-f11aa46a9cd8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:31.576617 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6c013b9e-2956-44b2-8f09-f11aa46a9cd8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:31.577726 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6c013b9e-2956-44b2-8f09-f11aa46a9cd8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:31.878502 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6c013b9e-2956-44b2-8f09-f11aa46a9cd8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:31.888259 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6c013b9e-2956-44b2-8f09-f11aa46a9cd8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.341710 May 28 17:27:31.889659 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 139/272] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:31 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:32.065629 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-43bd52e4-1242-4ab0-b936-2f99caddabec tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:32.066395 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-43bd52e4-1242-4ab0-b936-2f99caddabec tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:32.072791 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-43bd52e4-1242-4ab0-b936-2f99caddabec tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:32.073558 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-43bd52e4-1242-4ab0-b936-2f99caddabec tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:32.074536 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-43bd52e4-1242-4ab0-b936-2f99caddabec tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:32.074968 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-43bd52e4-1242-4ab0-b936-2f99caddabec tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:32.144542 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-43bd52e4-1242-4ab0-b936-2f99caddabec tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:32.152635 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-43bd52e4-1242-4ab0-b936-2f99caddabec tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:32.154417 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-43bd52e4-1242-4ab0-b936-2f99caddabec tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:32.155962 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-43bd52e4-1242-4ab0-b936-2f99caddabec tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1278 microversion: 2.20 time: 0.094527 May 28 17:27:32.157175 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 134/273] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:27:32 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1278 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:27:32.907564 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-007c7f07-54e0-4b1e-a76c-02f1a9d2af2f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:32.908732 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-007c7f07-54e0-4b1e-a76c-02f1a9d2af2f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:32.920865 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-007c7f07-54e0-4b1e-a76c-02f1a9d2af2f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:32.921542 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-007c7f07-54e0-4b1e-a76c-02f1a9d2af2f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:32.922490 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-007c7f07-54e0-4b1e-a76c-02f1a9d2af2f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:32.923960 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-007c7f07-54e0-4b1e-a76c-02f1a9d2af2f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:33.182144 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0ce7d845-3332-4c5a-9eff-0b5eca13c819 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:33.185100 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0ce7d845-3332-4c5a-9eff-0b5eca13c819 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:33.192637 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0ce7d845-3332-4c5a-9eff-0b5eca13c819 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:33.193389 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0ce7d845-3332-4c5a-9eff-0b5eca13c819 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:33.194336 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0ce7d845-3332-4c5a-9eff-0b5eca13c819 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:33.194938 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0ce7d845-3332-4c5a-9eff-0b5eca13c819 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:33.351735 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-007c7f07-54e0-4b1e-a76c-02f1a9d2af2f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:33.361402 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0ce7d845-3332-4c5a-9eff-0b5eca13c819 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:33.391559 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-007c7f07-54e0-4b1e-a76c-02f1a9d2af2f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.489158 May 28 17:27:33.392171 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 140/274] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:32 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:33.392923 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0ce7d845-3332-4c5a-9eff-0b5eca13c819 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:33.395381 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0ce7d845-3332-4c5a-9eff-0b5eca13c819 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:33.396427 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0ce7d845-3332-4c5a-9eff-0b5eca13c819 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1334 microversion: 2.20 time: 0.225643 May 28 17:27:33.411451 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 135/275] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:27:33 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1334 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:27:34.420821 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ad55d34c-9abe-4d82-93e5-137a5774dd60 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:34.422156 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ad55d34c-9abe-4d82-93e5-137a5774dd60 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:34.427000 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b3e22322-467c-4b71-9563-7c5942149df3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:34.428461 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b3e22322-467c-4b71-9563-7c5942149df3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:34.441854 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ad55d34c-9abe-4d82-93e5-137a5774dd60 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:34.444718 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b3e22322-467c-4b71-9563-7c5942149df3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:34.445332 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b3e22322-467c-4b71-9563-7c5942149df3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:34.450425 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b3e22322-467c-4b71-9563-7c5942149df3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:34.452646 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b3e22322-467c-4b71-9563-7c5942149df3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:34.453829 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ad55d34c-9abe-4d82-93e5-137a5774dd60 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:34.454857 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ad55d34c-9abe-4d82-93e5-137a5774dd60 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:34.455324 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ad55d34c-9abe-4d82-93e5-137a5774dd60 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:34.634110 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ad55d34c-9abe-4d82-93e5-137a5774dd60 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:34.646048 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ad55d34c-9abe-4d82-93e5-137a5774dd60 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:34.660769 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ad55d34c-9abe-4d82-93e5-137a5774dd60 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:34.662159 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ad55d34c-9abe-4d82-93e5-137a5774dd60 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1342 microversion: 2.20 time: 0.251997 May 28 17:27:34.663693 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 136/276] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:27:34 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1342 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:27:35.037060 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b3e22322-467c-4b71-9563-7c5942149df3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:35.049331 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b3e22322-467c-4b71-9563-7c5942149df3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1521 microversion: 2.1 time: 0.644050 May 28 17:27:35.049931 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 141/277] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:34 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1521 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:35.682585 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-01faaf8d-3d3f-4599-b5ef-56c58566aa0f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:35.684027 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-01faaf8d-3d3f-4599-b5ef-56c58566aa0f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:35.693504 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=6 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:27:35.695472 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-01faaf8d-3d3f-4599-b5ef-56c58566aa0f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:35.696093 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-01faaf8d-3d3f-4599-b5ef-56c58566aa0f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:35.697187 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-01faaf8d-3d3f-4599-b5ef-56c58566aa0f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:35.697677 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-01faaf8d-3d3f-4599-b5ef-56c58566aa0f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:35.807471 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-01faaf8d-3d3f-4599-b5ef-56c58566aa0f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:35.819943 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-01faaf8d-3d3f-4599-b5ef-56c58566aa0f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:35.821900 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-01faaf8d-3d3f-4599-b5ef-56c58566aa0f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:35.823221 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-01faaf8d-3d3f-4599-b5ef-56c58566aa0f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1340 microversion: 2.20 time: 0.145450 May 28 17:27:35.834369 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 137/278] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:27:35 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1340 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:27:36.068956 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2eacb0d2-2219-4633-b675-57cc0a156afb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:36.069592 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2eacb0d2-2219-4633-b675-57cc0a156afb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:36.073219 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:27:36.074270 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=6 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:27:36.078815 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2eacb0d2-2219-4633-b675-57cc0a156afb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:36.079283 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2eacb0d2-2219-4633-b675-57cc0a156afb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:36.080112 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2eacb0d2-2219-4633-b675-57cc0a156afb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:36.080554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2eacb0d2-2219-4633-b675-57cc0a156afb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:36.406349 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-2eacb0d2-2219-4633-b675-57cc0a156afb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:36.415157 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2eacb0d2-2219-4633-b675-57cc0a156afb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1501 microversion: 2.1 time: 0.350176 May 28 17:27:36.415991 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 142/279] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:36 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1501 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:36.433930 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8cc58d02-e5c1-4eee-ae45-2f1337179bcd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:36.434791 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8cc58d02-e5c1-4eee-ae45-2f1337179bcd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:36.442018 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8cc58d02-e5c1-4eee-ae45-2f1337179bcd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:36.442746 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8cc58d02-e5c1-4eee-ae45-2f1337179bcd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:36.444009 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8cc58d02-e5c1-4eee-ae45-2f1337179bcd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:36.445024 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8cc58d02-e5c1-4eee-ae45-2f1337179bcd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:36.655565 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8cc58d02-e5c1-4eee-ae45-2f1337179bcd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:36.666407 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8cc58d02-e5c1-4eee-ae45-2f1337179bcd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1515 microversion: 2.1 time: 0.236493 May 28 17:27:36.667331 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 138/280] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:36 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1515 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:36.851411 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f5c9dcca-c261-4096-b8ea-c9b065fd023b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:36.852341 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f5c9dcca-c261-4096-b8ea-c9b065fd023b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:36.869879 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f5c9dcca-c261-4096-b8ea-c9b065fd023b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:36.870682 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f5c9dcca-c261-4096-b8ea-c9b065fd023b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:36.873924 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f5c9dcca-c261-4096-b8ea-c9b065fd023b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:36.875433 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f5c9dcca-c261-4096-b8ea-c9b065fd023b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:37.385527 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f5c9dcca-c261-4096-b8ea-c9b065fd023b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:37.399898 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f5c9dcca-c261-4096-b8ea-c9b065fd023b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:37.401966 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f5c9dcca-c261-4096-b8ea-c9b065fd023b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:37.403372 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f5c9dcca-c261-4096-b8ea-c9b065fd023b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1408 microversion: 2.20 time: 0.565970 May 28 17:27:37.404959 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 143/281] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:27:36 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1408 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:27:38.195192 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-845b99bd-3f4d-4f06-af75-b99cbeee1878 req-c04132b1-035d-4240-beb6-0e69b12c4062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e52b200-7c75-45f2-92ed-813b306fc334", "tag": "48f2ad05-071e-4e67-9258-657db8e5bedf"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:27:38.214025 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-845b99bd-3f4d-4f06-af75-b99cbeee1878 req-c04132b1-035d-4240-beb6-0e69b12c4062 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:38.214500 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-845b99bd-3f4d-4f06-af75-b99cbeee1878 req-c04132b1-035d-4240-beb6-0e69b12c4062 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:38.219040 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=100 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:27:38.239175 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-845b99bd-3f4d-4f06-af75-b99cbeee1878 req-c04132b1-035d-4240-beb6-0e69b12c4062 service nova] Creating event network-changed:48f2ad05-071e-4e67-9258-657db8e5bedf for instance 1e52b200-7c75-45f2-92ed-813b306fc334 on hv-cinder-84372 May 28 17:27:38.244386 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-845b99bd-3f4d-4f06-af75-b99cbeee1878 req-c04132b1-035d-4240-beb6-0e69b12c4062 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053097 May 28 17:27:38.249692 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 139/282] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:27:38.423013 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-50cbb2e8-af99-4252-aa11-5dcf8e695bd5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:38.424010 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-50cbb2e8-af99-4252-aa11-5dcf8e695bd5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:38.428758 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:27:38.445441 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-50cbb2e8-af99-4252-aa11-5dcf8e695bd5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:38.446182 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-50cbb2e8-af99-4252-aa11-5dcf8e695bd5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:38.451124 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-50cbb2e8-af99-4252-aa11-5dcf8e695bd5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:38.451789 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-50cbb2e8-af99-4252-aa11-5dcf8e695bd5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:38.978609 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-50cbb2e8-af99-4252-aa11-5dcf8e695bd5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:39.016956 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-50cbb2e8-af99-4252-aa11-5dcf8e695bd5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:39.022177 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-50cbb2e8-af99-4252-aa11-5dcf8e695bd5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:39.025718 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-50cbb2e8-af99-4252-aa11-5dcf8e695bd5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1408 microversion: 2.20 time: 0.607526 May 28 17:27:39.031941 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 144/283] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:27:38 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1408 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:27:40.051199 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-81502b9f-a72c-4544-967d-f8f723985748 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:40.052574 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-81502b9f-a72c-4544-967d-f8f723985748 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:40.058870 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-81502b9f-a72c-4544-967d-f8f723985748 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:40.059562 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-81502b9f-a72c-4544-967d-f8f723985748 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:40.061343 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-81502b9f-a72c-4544-967d-f8f723985748 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:40.062154 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-81502b9f-a72c-4544-967d-f8f723985748 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:40.300378 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-81502b9f-a72c-4544-967d-f8f723985748 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:40.313729 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-81502b9f-a72c-4544-967d-f8f723985748 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:40.315449 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-81502b9f-a72c-4544-967d-f8f723985748 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:40.316612 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-81502b9f-a72c-4544-967d-f8f723985748 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1408 microversion: 2.20 time: 0.270945 May 28 17:27:40.318121 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 140/284] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:27:40 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1408 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:27:40.513305 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a5a633a0-d278-4e57-973c-d711ea1b3f79 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:27:40.514895 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a5a633a0-d278-4e57-973c-d711ea1b3f79 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:40.522707 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a5a633a0-d278-4e57-973c-d711ea1b3f79 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:40.523162 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a5a633a0-d278-4e57-973c-d711ea1b3f79 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:40.523951 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a5a633a0-d278-4e57-973c-d711ea1b3f79 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:40.524573 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a5a633a0-d278-4e57-973c-d711ea1b3f79 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:40.557465 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-a5a633a0-d278-4e57-973c-d711ea1b3f79 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lazy-loading 'flavor' on Instance uuid 1c3b0710-2e45-41e0-b02a-a9b95245f62a {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 17:27:40.807254 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a5a633a0-d278-4e57-973c-d711ea1b3f79 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "POST /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a/action" status: 200 len: 32 microversion: 2.1 time: 0.300563 May 28 17:27:40.808174 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 145/285] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 17:27:40 2022] POST /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a/action => generated 32 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 17:27:40.819815 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-dbce1e8b-0adf-4d31-9ae7-91cee5b7513d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:40.820547 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-dbce1e8b-0adf-4d31-9ae7-91cee5b7513d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:40.832622 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dbce1e8b-0adf-4d31-9ae7-91cee5b7513d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:40.835258 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dbce1e8b-0adf-4d31-9ae7-91cee5b7513d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:40.836410 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dbce1e8b-0adf-4d31-9ae7-91cee5b7513d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:40.838783 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dbce1e8b-0adf-4d31-9ae7-91cee5b7513d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:41.050033 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-dbce1e8b-0adf-4d31-9ae7-91cee5b7513d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:41.066337 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-dbce1e8b-0adf-4d31-9ae7-91cee5b7513d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.252233 May 28 17:27:41.067610 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 141/286] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:40 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:41.337773 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c11dd10c-e8ea-4a92-bd4a-4dec0ac94380 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:41.338505 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c11dd10c-e8ea-4a92-bd4a-4dec0ac94380 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:41.347211 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c11dd10c-e8ea-4a92-bd4a-4dec0ac94380 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:41.347690 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c11dd10c-e8ea-4a92-bd4a-4dec0ac94380 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:41.349818 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c11dd10c-e8ea-4a92-bd4a-4dec0ac94380 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:41.352908 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c11dd10c-e8ea-4a92-bd4a-4dec0ac94380 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:41.581016 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c11dd10c-e8ea-4a92-bd4a-4dec0ac94380 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:41.589663 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c11dd10c-e8ea-4a92-bd4a-4dec0ac94380 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:41.592153 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c11dd10c-e8ea-4a92-bd4a-4dec0ac94380 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:41.593351 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c11dd10c-e8ea-4a92-bd4a-4dec0ac94380 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1408 microversion: 2.20 time: 0.262567 May 28 17:27:41.594314 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 146/287] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:27:41 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1408 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:27:42.086044 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-18c42791-4868-4269-84b4-e1884c0cbdb8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:42.086797 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-18c42791-4868-4269-84b4-e1884c0cbdb8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:42.093918 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-18c42791-4868-4269-84b4-e1884c0cbdb8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:42.094477 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-18c42791-4868-4269-84b4-e1884c0cbdb8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:42.095593 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-18c42791-4868-4269-84b4-e1884c0cbdb8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:42.096244 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-18c42791-4868-4269-84b4-e1884c0cbdb8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:42.267185 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-18c42791-4868-4269-84b4-e1884c0cbdb8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:42.283991 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-18c42791-4868-4269-84b4-e1884c0cbdb8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.202268 May 28 17:27:42.288705 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 142/288] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:42 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:42.615315 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-818a6936-2eac-40a9-9d95-698e43a76046 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:42.617011 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-818a6936-2eac-40a9-9d95-698e43a76046 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:42.624340 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-818a6936-2eac-40a9-9d95-698e43a76046 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:42.625074 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-818a6936-2eac-40a9-9d95-698e43a76046 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:42.626864 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-818a6936-2eac-40a9-9d95-698e43a76046 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:42.627661 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-818a6936-2eac-40a9-9d95-698e43a76046 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:42.828108 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-818a6936-2eac-40a9-9d95-698e43a76046 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:42.837570 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-818a6936-2eac-40a9-9d95-698e43a76046 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:42.839665 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-818a6936-2eac-40a9-9d95-698e43a76046 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:42.841007 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-818a6936-2eac-40a9-9d95-698e43a76046 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1408 microversion: 2.20 time: 0.233723 May 28 17:27:42.842471 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 147/289] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:27:42 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1408 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:27:43.301810 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f1814b22-7cf1-42f6-ad78-f135ce536944 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:43.302925 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f1814b22-7cf1-42f6-ad78-f135ce536944 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:43.314996 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f1814b22-7cf1-42f6-ad78-f135ce536944 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:43.315845 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f1814b22-7cf1-42f6-ad78-f135ce536944 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:43.316860 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f1814b22-7cf1-42f6-ad78-f135ce536944 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:43.317515 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f1814b22-7cf1-42f6-ad78-f135ce536944 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:43.577990 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f1814b22-7cf1-42f6-ad78-f135ce536944 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:43.593000 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f1814b22-7cf1-42f6-ad78-f135ce536944 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.295111 May 28 17:27:43.604281 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 143/290] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:43 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:43.859028 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5afc37fa-af87-4f58-9f20-8d7dde9c85d3 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:43.862107 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5afc37fa-af87-4f58-9f20-8d7dde9c85d3 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:43.872094 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5afc37fa-af87-4f58-9f20-8d7dde9c85d3 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:43.876417 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5afc37fa-af87-4f58-9f20-8d7dde9c85d3 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:43.877411 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5afc37fa-af87-4f58-9f20-8d7dde9c85d3 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:43.878193 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5afc37fa-af87-4f58-9f20-8d7dde9c85d3 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:44.113259 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5afc37fa-af87-4f58-9f20-8d7dde9c85d3 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:44.122489 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5afc37fa-af87-4f58-9f20-8d7dde9c85d3 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:44.124652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5afc37fa-af87-4f58-9f20-8d7dde9c85d3 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:44.125947 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5afc37fa-af87-4f58-9f20-8d7dde9c85d3 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1408 microversion: 2.20 time: 0.271567 May 28 17:27:44.127246 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 148/291] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:27:43 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1408 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:27:44.612134 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8a2d0d39-e023-4957-b409-4d07527eafca tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:44.613420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8a2d0d39-e023-4957-b409-4d07527eafca tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:44.619768 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8a2d0d39-e023-4957-b409-4d07527eafca tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:44.620582 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8a2d0d39-e023-4957-b409-4d07527eafca tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:44.621636 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8a2d0d39-e023-4957-b409-4d07527eafca tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:44.622902 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8a2d0d39-e023-4957-b409-4d07527eafca tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:44.775872 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8a2d0d39-e023-4957-b409-4d07527eafca tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:44.785299 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8a2d0d39-e023-4957-b409-4d07527eafca tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.177560 May 28 17:27:44.785937 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 144/292] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:44 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:45.143681 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e7a957f1-ca63-4337-a00a-099d3929c472 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:45.144313 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e7a957f1-ca63-4337-a00a-099d3929c472 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:45.151363 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e7a957f1-ca63-4337-a00a-099d3929c472 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:45.151834 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e7a957f1-ca63-4337-a00a-099d3929c472 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:45.152611 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e7a957f1-ca63-4337-a00a-099d3929c472 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:45.153053 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e7a957f1-ca63-4337-a00a-099d3929c472 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:45.303457 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e7a957f1-ca63-4337-a00a-099d3929c472 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:45.312347 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e7a957f1-ca63-4337-a00a-099d3929c472 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:45.313967 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e7a957f1-ca63-4337-a00a-099d3929c472 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:45.315088 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e7a957f1-ca63-4337-a00a-099d3929c472 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1408 microversion: 2.20 time: 0.175618 May 28 17:27:45.315673 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 149/293] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:27:45 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:27:45.802684 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7fbfd5e3-504c-409e-af7e-1b44551c8c55 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:45.804415 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7fbfd5e3-504c-409e-af7e-1b44551c8c55 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:45.814833 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7fbfd5e3-504c-409e-af7e-1b44551c8c55 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:45.815434 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7fbfd5e3-504c-409e-af7e-1b44551c8c55 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:45.816300 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7fbfd5e3-504c-409e-af7e-1b44551c8c55 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:45.816755 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7fbfd5e3-504c-409e-af7e-1b44551c8c55 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:46.009391 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7fbfd5e3-504c-409e-af7e-1b44551c8c55 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:46.030527 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7fbfd5e3-504c-409e-af7e-1b44551c8c55 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.232324 May 28 17:27:46.035464 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 145/294] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:45 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:46.192157 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-cc3c8703-409e-4483-9e43-c3e3df06ac86 req-29977fd9-cc32-4588-b1b3-71325d8be80c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e52b200-7c75-45f2-92ed-813b306fc334", "name": "network-vif-plugged", "status": "completed", "tag": "48f2ad05-071e-4e67-9258-657db8e5bedf"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:27:46.206391 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-cc3c8703-409e-4483-9e43-c3e3df06ac86 req-29977fd9-cc32-4588-b1b3-71325d8be80c service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:46.209803 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-cc3c8703-409e-4483-9e43-c3e3df06ac86 req-29977fd9-cc32-4588-b1b3-71325d8be80c service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:46.227502 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-cc3c8703-409e-4483-9e43-c3e3df06ac86 req-29977fd9-cc32-4588-b1b3-71325d8be80c service nova] Creating event network-vif-plugged:48f2ad05-071e-4e67-9258-657db8e5bedf for instance 1e52b200-7c75-45f2-92ed-813b306fc334 on hv-cinder-84372 May 28 17:27:46.239652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-cc3c8703-409e-4483-9e43-c3e3df06ac86 req-29977fd9-cc32-4588-b1b3-71325d8be80c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051127 May 28 17:27:46.240452 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 150/295] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:27:46.335498 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-bf86b284-f83b-4c03-952b-abe738a09516 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:46.336480 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-bf86b284-f83b-4c03-952b-abe738a09516 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:46.346844 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bf86b284-f83b-4c03-952b-abe738a09516 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:46.347894 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bf86b284-f83b-4c03-952b-abe738a09516 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:46.348947 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bf86b284-f83b-4c03-952b-abe738a09516 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:46.350563 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bf86b284-f83b-4c03-952b-abe738a09516 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:46.626796 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bf86b284-f83b-4c03-952b-abe738a09516 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:46.635297 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bf86b284-f83b-4c03-952b-abe738a09516 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:46.643549 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bf86b284-f83b-4c03-952b-abe738a09516 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:46.644707 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-bf86b284-f83b-4c03-952b-abe738a09516 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1408 microversion: 2.20 time: 0.315513 May 28 17:27:46.645265 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 146/296] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:27:46 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1408 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:27:47.054279 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f330a68f-9138-48ed-b822-4613dd77f30b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:47.055453 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f330a68f-9138-48ed-b822-4613dd77f30b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:47.076458 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f330a68f-9138-48ed-b822-4613dd77f30b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:47.077269 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f330a68f-9138-48ed-b822-4613dd77f30b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:47.078828 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f330a68f-9138-48ed-b822-4613dd77f30b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:47.079829 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f330a68f-9138-48ed-b822-4613dd77f30b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:47.126559 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-634235cb-fece-43e8-8487-05892d2b6991 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c736832-e1ee-46a8-a85a-7ffacd9c4b7d", "device": "/dev/sdb"}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:27:47.128218 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-634235cb-fece-43e8-8487-05892d2b6991 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:47.134620 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-634235cb-fece-43e8-8487-05892d2b6991 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:47.135550 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-634235cb-fece-43e8-8487-05892d2b6991 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:47.136688 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-634235cb-fece-43e8-8487-05892d2b6991 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:47.137434 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-634235cb-fece-43e8-8487-05892d2b6991 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:47.250797 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f330a68f-9138-48ed-b822-4613dd77f30b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:47.261541 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f330a68f-9138-48ed-b822-4613dd77f30b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.218596 May 28 17:27:47.272253 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 151/297] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:47 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:47.662208 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5fa3742e-a2a0-4269-8cb7-c559ca47c2e6 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:47.663165 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5fa3742e-a2a0-4269-8cb7-c559ca47c2e6 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:47.672751 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5fa3742e-a2a0-4269-8cb7-c559ca47c2e6 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:47.673557 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5fa3742e-a2a0-4269-8cb7-c559ca47c2e6 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:47.674658 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5fa3742e-a2a0-4269-8cb7-c559ca47c2e6 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:47.675286 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5fa3742e-a2a0-4269-8cb7-c559ca47c2e6 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:47.681092 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:27:47.828755 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5fa3742e-a2a0-4269-8cb7-c559ca47c2e6 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:47.837943 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5fa3742e-a2a0-4269-8cb7-c559ca47c2e6 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:47.839739 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5fa3742e-a2a0-4269-8cb7-c559ca47c2e6 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:47.840931 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5fa3742e-a2a0-4269-8cb7-c559ca47c2e6 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1408 microversion: 2.20 time: 0.182824 May 28 17:27:47.852032 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 152/298] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:27:47 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1408 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:27:48.227093 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-634235cb-fece-43e8-8487-05892d2b6991 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "POST /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.105714 May 28 17:27:48.228218 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 147/299] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 17:27:47 2022] POST /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512/os-volume_attachments => generated 194 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:27:48.280661 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-823988f1-2274-43c5-8a8b-090922cd6df7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:48.282315 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-823988f1-2274-43c5-8a8b-090922cd6df7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:48.291772 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-823988f1-2274-43c5-8a8b-090922cd6df7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:48.299526 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-823988f1-2274-43c5-8a8b-090922cd6df7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:48.300690 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-823988f1-2274-43c5-8a8b-090922cd6df7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:48.301243 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-823988f1-2274-43c5-8a8b-090922cd6df7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:48.599635 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-823988f1-2274-43c5-8a8b-090922cd6df7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:48.623262 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-823988f1-2274-43c5-8a8b-090922cd6df7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.348464 May 28 17:27:48.623897 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 153/300] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:48 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:48.862634 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ef2bcfb8-654d-4256-a19c-ecf6da835883 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:48.863520 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ef2bcfb8-654d-4256-a19c-ecf6da835883 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:48.871564 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ef2bcfb8-654d-4256-a19c-ecf6da835883 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:48.873208 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ef2bcfb8-654d-4256-a19c-ecf6da835883 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:48.874193 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ef2bcfb8-654d-4256-a19c-ecf6da835883 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:48.874808 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ef2bcfb8-654d-4256-a19c-ecf6da835883 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:49.075519 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ef2bcfb8-654d-4256-a19c-ecf6da835883 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:49.088454 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ef2bcfb8-654d-4256-a19c-ecf6da835883 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:49.093848 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ef2bcfb8-654d-4256-a19c-ecf6da835883 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:49.096209 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ef2bcfb8-654d-4256-a19c-ecf6da835883 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1408 microversion: 2.20 time: 0.240000 May 28 17:27:49.097348 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 148/301] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:27:48 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1408 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:27:49.460597 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-66d88687-3224-4920-9fd4-62f1e8d04f2f tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Action: 'create', calling method: .version_select at 0x7f9efcb3baf0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1683839053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrYCif71+CO0ey4XVJmvGMRQ+ObzXNDeuwrumx6JP8UHSTaJsWU474Ut/OP9rzJSw3UJf2V+KLdxcNZABeC2i+cDISnfpY3BQyJphyC+LKtnxwUuWCTUL3hylj8G7qE9A=="}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:27:49.479588 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-66d88687-3224-4920-9fd4-62f1e8d04f2f tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Getting quotas for project 33d09d2e02c945a09e79efae8d8ab96c. Resources: {'key_pairs'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:27:49.483686 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-66d88687-3224-4920-9fd4-62f1e8d04f2f tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Getting quotas for user 681c8dec79764371badd23608ff4fa5a and project 33d09d2e02c945a09e79efae8d8ab96c. Resources: {'key_pairs'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:27:49.519713 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-66d88687-3224-4920-9fd4-62f1e8d04f2f tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.062845 May 28 17:27:49.520337 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 154/302] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 17:27:49 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:27:49.621610 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4833728d-7a89-493a-956e-5df7002d6bfc tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-357696885", "imageRef": "ec02e218-4d96-419e-aae6-8cdae4113ec9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1683839053", "networks": [{"uuid": "c2642da9-62f7-4baf-be4a-bb647a278cd8"}]}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:27:49.641941 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8582ae0a-d6ac-4c6a-bb3b-6ed89adc80d0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:49.642322 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8582ae0a-d6ac-4c6a-bb3b-6ed89adc80d0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:49.648573 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8582ae0a-d6ac-4c6a-bb3b-6ed89adc80d0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:49.649104 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8582ae0a-d6ac-4c6a-bb3b-6ed89adc80d0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:49.649941 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8582ae0a-d6ac-4c6a-bb3b-6ed89adc80d0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:49.650452 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8582ae0a-d6ac-4c6a-bb3b-6ed89adc80d0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:49.673130 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.network.neutron [None req-4833728d-7a89-493a-956e-5df7002d6bfc tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] validate_networks() for [('c2642da9-62f7-4baf-be4a-bb647a278cd8', None, None, None, None, None)] {{(pid=117605) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 17:27:49.788314 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8582ae0a-d6ac-4c6a-bb3b-6ed89adc80d0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:49.797111 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8582ae0a-d6ac-4c6a-bb3b-6ed89adc80d0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.160627 May 28 17:27:49.797739 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 155/303] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:49 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:27:50.044610 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-4833728d-7a89-493a-956e-5df7002d6bfc tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Flavor limits 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 17:27:50.045129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-4833728d-7a89-493a-956e-5df7002d6bfc tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Image limits 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 17:27:50.045657 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-4833728d-7a89-493a-956e-5df7002d6bfc tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Flavor pref 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 17:27:50.046114 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-4833728d-7a89-493a-956e-5df7002d6bfc tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Image pref 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 17:27:50.046593 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-4833728d-7a89-493a-956e-5df7002d6bfc tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 17:27:50.055257 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4833728d-7a89-493a-956e-5df7002d6bfc tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:50.055728 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4833728d-7a89-493a-956e-5df7002d6bfc tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:50.056517 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4833728d-7a89-493a-956e-5df7002d6bfc tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:50.056946 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4833728d-7a89-493a-956e-5df7002d6bfc tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:50.073049 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-4833728d-7a89-493a-956e-5df7002d6bfc tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Getting quotas for project 33d09d2e02c945a09e79efae8d8ab96c. Resources: {'instances', 'cores', 'ram'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:27:50.077400 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-4833728d-7a89-493a-956e-5df7002d6bfc tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Getting quotas for user 681c8dec79764371badd23608ff4fa5a and project 33d09d2e02c945a09e79efae8d8ab96c. Resources: {'instances', 'cores', 'ram'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:27:50.087881 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4833728d-7a89-493a-956e-5df7002d6bfc tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Going to run 1 instances... {{(pid=117605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 17:27:50.090030 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4833728d-7a89-493a-956e-5df7002d6bfc tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ec02e218-4d96-419e-aae6-8cdae4113ec9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 17:27:50.114278 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-401d0d91-c727-484a-accf-90d77ad50476 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:50.114919 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-401d0d91-c727-484a-accf-90d77ad50476 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:50.121016 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-401d0d91-c727-484a-accf-90d77ad50476 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:50.121496 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-401d0d91-c727-484a-accf-90d77ad50476 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:50.122541 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-401d0d91-c727-484a-accf-90d77ad50476 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:50.123027 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-401d0d91-c727-484a-accf-90d77ad50476 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:50.139539 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4833728d-7a89-493a-956e-5df7002d6bfc tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521661 May 28 17:27:50.140187 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 149/304] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 17:27:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 17:27:50.149649 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e43f3dac-e750-488b-af08-15d6aefb3644 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:50.150261 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-e43f3dac-e750-488b-af08-15d6aefb3644 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:50.213114 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-e43f3dac-e750-488b-af08-15d6aefb3644 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:50.220690 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-e43f3dac-e750-488b-af08-15d6aefb3644 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1258 microversion: 2.1 time: 0.074697 May 28 17:27:50.221265 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 150/305] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:50 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:27:50.264824 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-401d0d91-c727-484a-accf-90d77ad50476 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:50.275590 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-401d0d91-c727-484a-accf-90d77ad50476 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:50.277277 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-401d0d91-c727-484a-accf-90d77ad50476 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:50.278456 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-401d0d91-c727-484a-accf-90d77ad50476 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1600 microversion: 2.20 time: 0.168226 May 28 17:27:50.279663 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 156/306] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:27:50 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1600 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:27:50.296159 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-78bf5051-913d-4d1d-8b1a-a36e712973fc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:50.296665 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-78bf5051-913d-4d1d-8b1a-a36e712973fc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:50.302686 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-78bf5051-913d-4d1d-8b1a-a36e712973fc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:50.303136 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-78bf5051-913d-4d1d-8b1a-a36e712973fc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:50.303930 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-78bf5051-913d-4d1d-8b1a-a36e712973fc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:50.304368 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-78bf5051-913d-4d1d-8b1a-a36e712973fc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:50.416044 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-78bf5051-913d-4d1d-8b1a-a36e712973fc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.123605 May 28 17:27:50.416785 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 151/307] 10.222.0.33 () {60 vars in 1315 bytes} [Sat May 28 17:27:50 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 17:27:50.463096 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-198d7a1a-98c5-4719-a234-7b0a15a3a5cf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1375110484", "imageRef": "b2aab55c-a793-472a-bc32-81af689ad609", "flavorRef": "452", "networks": [{"uuid": "75e9d121-0dd7-4765-8420-f3e8c1d9b007"}]}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:27:50.521695 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.network.neutron [None req-198d7a1a-98c5-4719-a234-7b0a15a3a5cf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] validate_networks() for [('75e9d121-0dd7-4765-8420-f3e8c1d9b007', None, None, None, None, None)] {{(pid=117604) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 17:27:50.814298 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9718555d-e26a-4ea7-af5f-b75438bf5351 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:50.815771 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9718555d-e26a-4ea7-af5f-b75438bf5351 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:50.823257 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9718555d-e26a-4ea7-af5f-b75438bf5351 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:50.830739 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9718555d-e26a-4ea7-af5f-b75438bf5351 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:50.831904 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9718555d-e26a-4ea7-af5f-b75438bf5351 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:50.832525 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9718555d-e26a-4ea7-af5f-b75438bf5351 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:50.955479 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-198d7a1a-98c5-4719-a234-7b0a15a3a5cf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Flavor limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 17:27:50.956118 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-198d7a1a-98c5-4719-a234-7b0a15a3a5cf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Image limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 17:27:50.956678 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-198d7a1a-98c5-4719-a234-7b0a15a3a5cf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Flavor pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 17:27:50.957196 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-198d7a1a-98c5-4719-a234-7b0a15a3a5cf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Image pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 17:27:50.957674 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-198d7a1a-98c5-4719-a234-7b0a15a3a5cf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 17:27:50.971363 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-198d7a1a-98c5-4719-a234-7b0a15a3a5cf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:50.971806 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-198d7a1a-98c5-4719-a234-7b0a15a3a5cf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:50.972609 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-198d7a1a-98c5-4719-a234-7b0a15a3a5cf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:50.973055 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-198d7a1a-98c5-4719-a234-7b0a15a3a5cf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:50.991564 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-198d7a1a-98c5-4719-a234-7b0a15a3a5cf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Getting quotas for project 9065845ed3d0457c9ab0889760958a32. Resources: {'instances', 'cores', 'ram'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:27:50.995952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-198d7a1a-98c5-4719-a234-7b0a15a3a5cf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Getting quotas for user 14273a09857f431bb7841b321b913c00 and project 9065845ed3d0457c9ab0889760958a32. Resources: {'instances', 'cores', 'ram'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:27:51.008161 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-198d7a1a-98c5-4719-a234-7b0a15a3a5cf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Going to run 1 instances... {{(pid=117604) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 17:27:51.010440 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-198d7a1a-98c5-4719-a234-7b0a15a3a5cf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b2aab55c-a793-472a-bc32-81af689ad609',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 17:27:51.057565 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-198d7a1a-98c5-4719-a234-7b0a15a3a5cf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599279 May 28 17:27:51.058204 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 157/308] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 17:27:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 17:27:51.068981 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f7bfaaaa-d966-4e55-92c8-2efbc2d4c029 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:51.069745 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f7bfaaaa-d966-4e55-92c8-2efbc2d4c029 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:51.128937 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f7bfaaaa-d966-4e55-92c8-2efbc2d4c029 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:51.136088 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f7bfaaaa-d966-4e55-92c8-2efbc2d4c029 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1214 microversion: 2.1 time: 0.071226 May 28 17:27:51.136824 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 158/309] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:51 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:27:51.241043 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0f04d26b-6d67-4a1d-834b-aad4249fad0c tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:51.241717 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0f04d26b-6d67-4a1d-834b-aad4249fad0c tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:51.264265 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0f04d26b-6d67-4a1d-834b-aad4249fad0c tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:51.265137 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0f04d26b-6d67-4a1d-834b-aad4249fad0c tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:51.266142 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0f04d26b-6d67-4a1d-834b-aad4249fad0c tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:51.266870 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0f04d26b-6d67-4a1d-834b-aad4249fad0c tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:51.306515 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-9718555d-e26a-4ea7-af5f-b75438bf5351 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:51.321097 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9718555d-e26a-4ea7-af5f-b75438bf5351 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.510733 May 28 17:27:51.322400 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 152/310] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:50 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:27:51.374348 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0f04d26b-6d67-4a1d-834b-aad4249fad0c tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:51.387280 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0f04d26b-6d67-4a1d-834b-aad4249fad0c tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1310 microversion: 2.1 time: 0.151673 May 28 17:27:51.390353 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 159/311] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:51 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1310 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:27:52.153248 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a0df3ee1-1dbb-47b8-8dc4-a4d98016ecec tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:52.154485 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a0df3ee1-1dbb-47b8-8dc4-a4d98016ecec tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:52.161135 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a0df3ee1-1dbb-47b8-8dc4-a4d98016ecec tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:52.161824 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a0df3ee1-1dbb-47b8-8dc4-a4d98016ecec tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:52.162999 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a0df3ee1-1dbb-47b8-8dc4-a4d98016ecec tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:52.163611 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a0df3ee1-1dbb-47b8-8dc4-a4d98016ecec tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:52.241957 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a0df3ee1-1dbb-47b8-8dc4-a4d98016ecec tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:52.257597 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a0df3ee1-1dbb-47b8-8dc4-a4d98016ecec tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1266 microversion: 2.1 time: 0.108021 May 28 17:27:52.258187 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 153/312] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:52 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:52.339566 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9be2f184-7dc1-4b8e-8c33-fae022d04172 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:52.340305 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9be2f184-7dc1-4b8e-8c33-fae022d04172 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:52.361923 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9be2f184-7dc1-4b8e-8c33-fae022d04172 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:52.362385 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9be2f184-7dc1-4b8e-8c33-fae022d04172 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:52.363179 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9be2f184-7dc1-4b8e-8c33-fae022d04172 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:52.363657 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9be2f184-7dc1-4b8e-8c33-fae022d04172 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:52.405474 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2949a716-54c1-4420-b58b-f595e7322527 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:52.405935 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2949a716-54c1-4420-b58b-f595e7322527 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:52.417390 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2949a716-54c1-4420-b58b-f595e7322527 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:52.417843 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2949a716-54c1-4420-b58b-f595e7322527 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:52.439661 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2949a716-54c1-4420-b58b-f595e7322527 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:52.440501 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2949a716-54c1-4420-b58b-f595e7322527 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:52.658509 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9be2f184-7dc1-4b8e-8c33-fae022d04172 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:52.666622 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9be2f184-7dc1-4b8e-8c33-fae022d04172 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.331524 May 28 17:27:52.676434 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 160/313] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:52 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:52.777893 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-c2e91043-0728-4648-9f3e-e458c6d397bb req-9aee3dca-e373-42ce-8c31-d5ecd25b2cfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e52b200-7c75-45f2-92ed-813b306fc334", "tag": "48f2ad05-071e-4e67-9258-657db8e5bedf"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:27:52.795595 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-c2e91043-0728-4648-9f3e-e458c6d397bb req-9aee3dca-e373-42ce-8c31-d5ecd25b2cfd service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:52.796186 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-c2e91043-0728-4648-9f3e-e458c6d397bb req-9aee3dca-e373-42ce-8c31-d5ecd25b2cfd service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:52.818449 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-c2e91043-0728-4648-9f3e-e458c6d397bb req-9aee3dca-e373-42ce-8c31-d5ecd25b2cfd service nova] Creating event network-changed:48f2ad05-071e-4e67-9258-657db8e5bedf for instance 1e52b200-7c75-45f2-92ed-813b306fc334 on hv-cinder-84372 May 28 17:27:52.824461 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-c2e91043-0728-4648-9f3e-e458c6d397bb req-9aee3dca-e373-42ce-8c31-d5ecd25b2cfd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050191 May 28 17:27:52.825801 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 161/314] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:27:52.847359 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2949a716-54c1-4420-b58b-f595e7322527 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:52.856524 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2949a716-54c1-4420-b58b-f595e7322527 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.456119 May 28 17:27:52.857398 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 154/315] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:52 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:27:53.280417 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-059c290b-97e7-4c7b-a795-bcfab9fa6a6f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:53.281343 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-059c290b-97e7-4c7b-a795-bcfab9fa6a6f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:53.297661 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-059c290b-97e7-4c7b-a795-bcfab9fa6a6f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:53.298341 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-059c290b-97e7-4c7b-a795-bcfab9fa6a6f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:53.299380 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-059c290b-97e7-4c7b-a795-bcfab9fa6a6f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:53.299988 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-059c290b-97e7-4c7b-a795-bcfab9fa6a6f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:53.375194 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-059c290b-97e7-4c7b-a795-bcfab9fa6a6f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:53.383359 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-059c290b-97e7-4c7b-a795-bcfab9fa6a6f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1266 microversion: 2.1 time: 0.111176 May 28 17:27:53.383940 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 162/316] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:53 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1266 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:53.683803 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-be0f7cd1-d96b-4b99-9a5c-bfc7ebc9d1a7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:53.684455 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-be0f7cd1-d96b-4b99-9a5c-bfc7ebc9d1a7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:53.706834 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-be0f7cd1-d96b-4b99-9a5c-bfc7ebc9d1a7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:53.707302 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-be0f7cd1-d96b-4b99-9a5c-bfc7ebc9d1a7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:53.708125 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-be0f7cd1-d96b-4b99-9a5c-bfc7ebc9d1a7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:53.708566 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-be0f7cd1-d96b-4b99-9a5c-bfc7ebc9d1a7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:53.876745 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f91abbf5-4aaf-42e6-b947-66b10c7d5daf tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:53.877298 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f91abbf5-4aaf-42e6-b947-66b10c7d5daf tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:53.879838 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-be0f7cd1-d96b-4b99-9a5c-bfc7ebc9d1a7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:53.886385 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f91abbf5-4aaf-42e6-b947-66b10c7d5daf tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:53.887116 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f91abbf5-4aaf-42e6-b947-66b10c7d5daf tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:53.888221 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f91abbf5-4aaf-42e6-b947-66b10c7d5daf tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:53.889163 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f91abbf5-4aaf-42e6-b947-66b10c7d5daf tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:53.889377 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-be0f7cd1-d96b-4b99-9a5c-bfc7ebc9d1a7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.209157 May 28 17:27:53.891320 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 155/317] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:53 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:54.051286 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f91abbf5-4aaf-42e6-b947-66b10c7d5daf tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:54.058771 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f91abbf5-4aaf-42e6-b947-66b10c7d5daf tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.188308 May 28 17:27:54.059330 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 163/318] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:53 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:54.401234 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5184fed6-c85b-4982-be81-40bdc009120f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:54.401968 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5184fed6-c85b-4982-be81-40bdc009120f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:54.408511 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5184fed6-c85b-4982-be81-40bdc009120f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:54.408964 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5184fed6-c85b-4982-be81-40bdc009120f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:54.409751 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5184fed6-c85b-4982-be81-40bdc009120f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:54.410168 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5184fed6-c85b-4982-be81-40bdc009120f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:54.492812 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5184fed6-c85b-4982-be81-40bdc009120f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:54.502334 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5184fed6-c85b-4982-be81-40bdc009120f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1266 microversion: 2.1 time: 0.105659 May 28 17:27:54.502923 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 156/319] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:54 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1266 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:54.909149 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-66cf1e28-7cbf-4522-af0c-7722b539a4e2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:54.910530 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-66cf1e28-7cbf-4522-af0c-7722b539a4e2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:54.916777 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-66cf1e28-7cbf-4522-af0c-7722b539a4e2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:54.917302 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-66cf1e28-7cbf-4522-af0c-7722b539a4e2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:54.918166 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-66cf1e28-7cbf-4522-af0c-7722b539a4e2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:54.918675 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-66cf1e28-7cbf-4522-af0c-7722b539a4e2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:55.078352 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-66cf1e28-7cbf-4522-af0c-7722b539a4e2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:55.078896 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6b3aff09-318d-4804-99ad-05b5ec5901c4 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:55.079569 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6b3aff09-318d-4804-99ad-05b5ec5901c4 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:55.085800 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6b3aff09-318d-4804-99ad-05b5ec5901c4 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:55.086257 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6b3aff09-318d-4804-99ad-05b5ec5901c4 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:55.087313 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6b3aff09-318d-4804-99ad-05b5ec5901c4 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:55.087783 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6b3aff09-318d-4804-99ad-05b5ec5901c4 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:55.090919 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-66cf1e28-7cbf-4522-af0c-7722b539a4e2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.186701 May 28 17:27:55.091631 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 164/320] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:54 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:55.102649 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:27:55.255620 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-6b3aff09-318d-4804-99ad-05b5ec5901c4 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:55.263963 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6b3aff09-318d-4804-99ad-05b5ec5901c4 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.190223 May 28 17:27:55.265118 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 157/321] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:55 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:27:55.520058 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3b3c38de-458d-41c4-924f-82f51656f6f7 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:55.520588 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3b3c38de-458d-41c4-924f-82f51656f6f7 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:55.526586 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3b3c38de-458d-41c4-924f-82f51656f6f7 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:55.527033 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3b3c38de-458d-41c4-924f-82f51656f6f7 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:55.528099 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3b3c38de-458d-41c4-924f-82f51656f6f7 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:55.528572 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3b3c38de-458d-41c4-924f-82f51656f6f7 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:55.592726 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-3b3c38de-458d-41c4-924f-82f51656f6f7 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:55.600085 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3b3c38de-458d-41c4-924f-82f51656f6f7 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1266 microversion: 2.1 time: 0.083997 May 28 17:27:55.600644 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 165/322] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:55 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:56.112862 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8f0be331-797e-4e52-8d5e-35066f32ccb9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:56.113619 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8f0be331-797e-4e52-8d5e-35066f32ccb9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:56.122331 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8f0be331-797e-4e52-8d5e-35066f32ccb9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:56.122821 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8f0be331-797e-4e52-8d5e-35066f32ccb9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:56.123889 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8f0be331-797e-4e52-8d5e-35066f32ccb9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:56.124370 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8f0be331-797e-4e52-8d5e-35066f32ccb9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:56.278492 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8f0be331-797e-4e52-8d5e-35066f32ccb9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:56.283394 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a9c7e159-f13b-475d-a467-8833b4cfa41e tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:56.284145 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a9c7e159-f13b-475d-a467-8833b4cfa41e tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:56.288807 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8f0be331-797e-4e52-8d5e-35066f32ccb9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.183713 May 28 17:27:56.289389 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 158/323] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:56 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:27:56.291267 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a9c7e159-f13b-475d-a467-8833b4cfa41e tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:56.291848 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a9c7e159-f13b-475d-a467-8833b4cfa41e tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:56.292725 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a9c7e159-f13b-475d-a467-8833b4cfa41e tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:56.293308 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a9c7e159-f13b-475d-a467-8833b4cfa41e tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:56.453279 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a9c7e159-f13b-475d-a467-8833b4cfa41e tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:56.464702 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a9c7e159-f13b-475d-a467-8833b4cfa41e tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.186346 May 28 17:27:56.465292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 166/324] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:56 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:56.618037 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7e25fabf-bfdc-4aac-ba07-a96b1a60860d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:56.618956 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7e25fabf-bfdc-4aac-ba07-a96b1a60860d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:56.627013 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7e25fabf-bfdc-4aac-ba07-a96b1a60860d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:56.627733 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7e25fabf-bfdc-4aac-ba07-a96b1a60860d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:56.628591 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7e25fabf-bfdc-4aac-ba07-a96b1a60860d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:56.629206 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7e25fabf-bfdc-4aac-ba07-a96b1a60860d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:56.707124 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7e25fabf-bfdc-4aac-ba07-a96b1a60860d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:56.717216 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7e25fabf-bfdc-4aac-ba07-a96b1a60860d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1266 microversion: 2.1 time: 0.102566 May 28 17:27:56.718032 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 159/325] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:56 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:57.309833 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-fe7701db-8dc6-4f1d-8f9b-4fcf32ab0657 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:57.311219 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-fe7701db-8dc6-4f1d-8f9b-4fcf32ab0657 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:57.317630 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fe7701db-8dc6-4f1d-8f9b-4fcf32ab0657 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:57.318073 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fe7701db-8dc6-4f1d-8f9b-4fcf32ab0657 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:57.318917 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fe7701db-8dc6-4f1d-8f9b-4fcf32ab0657 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:57.319372 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fe7701db-8dc6-4f1d-8f9b-4fcf32ab0657 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:57.462460 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-fe7701db-8dc6-4f1d-8f9b-4fcf32ab0657 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:57.470397 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-fe7701db-8dc6-4f1d-8f9b-4fcf32ab0657 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.164388 May 28 17:27:57.470963 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 167/326] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:57 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:57.482398 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ca3b4191-bb1b-4418-93cd-4877ee699141 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:57.483120 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ca3b4191-bb1b-4418-93cd-4877ee699141 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:57.489659 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ca3b4191-bb1b-4418-93cd-4877ee699141 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:57.490112 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ca3b4191-bb1b-4418-93cd-4877ee699141 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:57.490874 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ca3b4191-bb1b-4418-93cd-4877ee699141 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:57.491314 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ca3b4191-bb1b-4418-93cd-4877ee699141 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:57.625526 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ca3b4191-bb1b-4418-93cd-4877ee699141 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:57.632919 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ca3b4191-bb1b-4418-93cd-4877ee699141 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.154876 May 28 17:27:57.633479 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 160/327] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:57 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:27:57.736243 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-323cc74a-5f0e-4073-9576-bdfe65fb0916 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:57.736858 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-323cc74a-5f0e-4073-9576-bdfe65fb0916 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:57.742824 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-323cc74a-5f0e-4073-9576-bdfe65fb0916 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:57.743315 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-323cc74a-5f0e-4073-9576-bdfe65fb0916 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:57.744100 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-323cc74a-5f0e-4073-9576-bdfe65fb0916 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:57.744538 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-323cc74a-5f0e-4073-9576-bdfe65fb0916 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:57.808658 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-323cc74a-5f0e-4073-9576-bdfe65fb0916 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:57.816028 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-323cc74a-5f0e-4073-9576-bdfe65fb0916 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1266 microversion: 2.1 time: 0.084289 May 28 17:27:57.816591 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 168/328] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:57 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:58.488135 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ad9660af-be9f-4564-a3c2-1eeefbab07aa tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:58.488753 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ad9660af-be9f-4564-a3c2-1eeefbab07aa tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:58.490999 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:27:58.496530 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ad9660af-be9f-4564-a3c2-1eeefbab07aa tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:58.496989 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ad9660af-be9f-4564-a3c2-1eeefbab07aa tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:58.498017 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ad9660af-be9f-4564-a3c2-1eeefbab07aa tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:58.499249 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ad9660af-be9f-4564-a3c2-1eeefbab07aa tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:58.633231 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ad9660af-be9f-4564-a3c2-1eeefbab07aa tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:58.641490 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ad9660af-be9f-4564-a3c2-1eeefbab07aa tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.157322 May 28 17:27:58.642054 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 161/329] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:58 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:58.649615 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9c64b4ac-f967-4391-8253-58e47e9359d2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:58.650301 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9c64b4ac-f967-4391-8253-58e47e9359d2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:58.656957 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9c64b4ac-f967-4391-8253-58e47e9359d2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:58.657400 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9c64b4ac-f967-4391-8253-58e47e9359d2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:58.658161 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9c64b4ac-f967-4391-8253-58e47e9359d2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:58.658590 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9c64b4ac-f967-4391-8253-58e47e9359d2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:58.796252 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9c64b4ac-f967-4391-8253-58e47e9359d2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:58.803670 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9c64b4ac-f967-4391-8253-58e47e9359d2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.157867 May 28 17:27:58.804233 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 169/330] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:58 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:58.833459 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1a6d9f7b-19ed-4f0a-ba54-83307034ba81 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:58.834103 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1a6d9f7b-19ed-4f0a-ba54-83307034ba81 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:58.840340 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1a6d9f7b-19ed-4f0a-ba54-83307034ba81 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:58.840997 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1a6d9f7b-19ed-4f0a-ba54-83307034ba81 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:58.841776 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1a6d9f7b-19ed-4f0a-ba54-83307034ba81 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:58.842247 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1a6d9f7b-19ed-4f0a-ba54-83307034ba81 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:58.915937 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1a6d9f7b-19ed-4f0a-ba54-83307034ba81 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:58.923629 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1a6d9f7b-19ed-4f0a-ba54-83307034ba81 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1266 microversion: 2.1 time: 0.093990 May 28 17:27:58.924281 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 162/331] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:58 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:27:59.659191 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-548412d9-1a41-452e-81ff-c0444a03c1a4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:59.660744 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-548412d9-1a41-452e-81ff-c0444a03c1a4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:59.669390 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-548412d9-1a41-452e-81ff-c0444a03c1a4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:59.669390 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-548412d9-1a41-452e-81ff-c0444a03c1a4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:59.670191 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-548412d9-1a41-452e-81ff-c0444a03c1a4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:59.671128 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-548412d9-1a41-452e-81ff-c0444a03c1a4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:59.821600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-84f781a0-4451-494f-9a41-166fb4a42783 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:59.822425 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-84f781a0-4451-494f-9a41-166fb4a42783 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:59.829597 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-84f781a0-4451-494f-9a41-166fb4a42783 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:59.830055 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-84f781a0-4451-494f-9a41-166fb4a42783 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:59.830949 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-84f781a0-4451-494f-9a41-166fb4a42783 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:59.831259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-84f781a0-4451-494f-9a41-166fb4a42783 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:59.847727 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-548412d9-1a41-452e-81ff-c0444a03c1a4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:27:59.855166 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-548412d9-1a41-452e-81ff-c0444a03c1a4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.200453 May 28 17:27:59.856034 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 170/332] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:59 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:27:59.941550 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9222d55e-2dca-4c9d-9394-113e335a38dc tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:27:59.942477 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9222d55e-2dca-4c9d-9394-113e335a38dc tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:27:59.955750 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9222d55e-2dca-4c9d-9394-113e335a38dc tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:59.956614 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9222d55e-2dca-4c9d-9394-113e335a38dc tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:27:59.957799 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9222d55e-2dca-4c9d-9394-113e335a38dc tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:27:59.958309 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9222d55e-2dca-4c9d-9394-113e335a38dc tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:00.037137 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9222d55e-2dca-4c9d-9394-113e335a38dc tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:00.047403 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9222d55e-2dca-4c9d-9394-113e335a38dc tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1266 microversion: 2.1 time: 0.109550 May 28 17:28:00.048067 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 171/333] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:59 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1266 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:00.064450 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=2 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:28:00.179285 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-84f781a0-4451-494f-9a41-166fb4a42783 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:00.187185 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-84f781a0-4451-494f-9a41-166fb4a42783 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.370039 May 28 17:28:00.187780 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 163/334] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:27:59 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:00.873616 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0de80111-8848-4faf-be9e-4c710db76c08 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:00.874450 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0de80111-8848-4faf-be9e-4c710db76c08 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:00.880968 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0de80111-8848-4faf-be9e-4c710db76c08 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:00.881410 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0de80111-8848-4faf-be9e-4c710db76c08 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:00.882168 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0de80111-8848-4faf-be9e-4c710db76c08 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:00.882598 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0de80111-8848-4faf-be9e-4c710db76c08 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:00.885304 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=100 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:28:00.982313 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:28:01.028498 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0de80111-8848-4faf-be9e-4c710db76c08 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:01.036566 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0de80111-8848-4faf-be9e-4c710db76c08 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.167194 May 28 17:28:01.046553 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 172/335] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:00 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:01.064582 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2d158a36-e027-444d-a52a-3c95e4ca2d02 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:01.065363 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2d158a36-e027-444d-a52a-3c95e4ca2d02 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:01.067315 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=8 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:28:01.074069 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2d158a36-e027-444d-a52a-3c95e4ca2d02 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:01.074525 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2d158a36-e027-444d-a52a-3c95e4ca2d02 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:01.075299 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2d158a36-e027-444d-a52a-3c95e4ca2d02 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:01.075771 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2d158a36-e027-444d-a52a-3c95e4ca2d02 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:01.140682 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2d158a36-e027-444d-a52a-3c95e4ca2d02 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:01.148527 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2d158a36-e027-444d-a52a-3c95e4ca2d02 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1266 microversion: 2.1 time: 0.087872 May 28 17:28:01.149133 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 164/336] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:01 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:01.204545 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-770e0fd0-1355-424e-aafb-f1d2d1f1e990 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:01.205151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-770e0fd0-1355-424e-aafb-f1d2d1f1e990 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:01.206987 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=12 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:28:01.212759 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-770e0fd0-1355-424e-aafb-f1d2d1f1e990 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:01.216128 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-770e0fd0-1355-424e-aafb-f1d2d1f1e990 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:01.216128 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-770e0fd0-1355-424e-aafb-f1d2d1f1e990 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:01.216128 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-770e0fd0-1355-424e-aafb-f1d2d1f1e990 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:01.351742 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-770e0fd0-1355-424e-aafb-f1d2d1f1e990 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:01.360087 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-770e0fd0-1355-424e-aafb-f1d2d1f1e990 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.159794 May 28 17:28:01.360846 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 173/337] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:01 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:02.054902 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-fc1b3a92-b65a-4cbc-b6b6-e326cc8cd5d8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:02.055552 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-fc1b3a92-b65a-4cbc-b6b6-e326cc8cd5d8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:02.062099 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fc1b3a92-b65a-4cbc-b6b6-e326cc8cd5d8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:02.062544 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fc1b3a92-b65a-4cbc-b6b6-e326cc8cd5d8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:02.063299 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fc1b3a92-b65a-4cbc-b6b6-e326cc8cd5d8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:02.063763 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fc1b3a92-b65a-4cbc-b6b6-e326cc8cd5d8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:02.166733 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a167e7a5-4f6a-405b-ba36-8a0100aef777 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:02.167386 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a167e7a5-4f6a-405b-ba36-8a0100aef777 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:02.182637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a167e7a5-4f6a-405b-ba36-8a0100aef777 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:02.188585 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a167e7a5-4f6a-405b-ba36-8a0100aef777 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:02.189694 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a167e7a5-4f6a-405b-ba36-8a0100aef777 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:02.190764 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a167e7a5-4f6a-405b-ba36-8a0100aef777 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:02.209887 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-fc1b3a92-b65a-4cbc-b6b6-e326cc8cd5d8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:02.221096 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-fc1b3a92-b65a-4cbc-b6b6-e326cc8cd5d8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.170291 May 28 17:28:02.222487 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 165/338] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:02 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:02.273031 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a167e7a5-4f6a-405b-ba36-8a0100aef777 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:02.280935 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a167e7a5-4f6a-405b-ba36-8a0100aef777 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1266 microversion: 2.1 time: 0.118883 May 28 17:28:02.281518 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 174/339] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:02 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1266 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:02.377833 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5fb8e12f-28eb-4da0-849a-6848ad7778c0 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:02.378443 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5fb8e12f-28eb-4da0-849a-6848ad7778c0 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:02.384448 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5fb8e12f-28eb-4da0-849a-6848ad7778c0 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:02.384911 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5fb8e12f-28eb-4da0-849a-6848ad7778c0 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:02.385666 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5fb8e12f-28eb-4da0-849a-6848ad7778c0 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:02.386105 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5fb8e12f-28eb-4da0-849a-6848ad7778c0 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:02.559518 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5fb8e12f-28eb-4da0-849a-6848ad7778c0 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:02.567753 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5fb8e12f-28eb-4da0-849a-6848ad7778c0 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.194496 May 28 17:28:02.568321 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 166/340] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:02 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:03.238642 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-eb97dc5a-31e7-4570-8991-40ac0e651d2c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:03.239392 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-eb97dc5a-31e7-4570-8991-40ac0e651d2c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:03.245873 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-eb97dc5a-31e7-4570-8991-40ac0e651d2c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:03.246341 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-eb97dc5a-31e7-4570-8991-40ac0e651d2c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:03.247091 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-eb97dc5a-31e7-4570-8991-40ac0e651d2c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:03.247804 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-eb97dc5a-31e7-4570-8991-40ac0e651d2c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:03.299463 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-10059d8c-f671-4efe-8a1e-ec3067ec8a54 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:03.300149 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-10059d8c-f671-4efe-8a1e-ec3067ec8a54 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:03.306692 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-10059d8c-f671-4efe-8a1e-ec3067ec8a54 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:03.311689 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-10059d8c-f671-4efe-8a1e-ec3067ec8a54 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:03.312827 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-10059d8c-f671-4efe-8a1e-ec3067ec8a54 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:03.313482 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-10059d8c-f671-4efe-8a1e-ec3067ec8a54 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:03.395257 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-10059d8c-f671-4efe-8a1e-ec3067ec8a54 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:03.403595 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-10059d8c-f671-4efe-8a1e-ec3067ec8a54 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1266 microversion: 2.1 time: 0.109199 May 28 17:28:03.404184 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 167/341] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:03 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:03.408603 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-eb97dc5a-31e7-4570-8991-40ac0e651d2c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:03.417068 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-eb97dc5a-31e7-4570-8991-40ac0e651d2c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.182240 May 28 17:28:03.417731 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 175/342] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:03 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:03.589425 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ee9b2166-bd5c-4240-9834-cd7fb98993d2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:03.590601 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ee9b2166-bd5c-4240-9834-cd7fb98993d2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:03.599877 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ee9b2166-bd5c-4240-9834-cd7fb98993d2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:03.600419 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ee9b2166-bd5c-4240-9834-cd7fb98993d2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:03.602263 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ee9b2166-bd5c-4240-9834-cd7fb98993d2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:03.602654 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ee9b2166-bd5c-4240-9834-cd7fb98993d2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:03.744496 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ee9b2166-bd5c-4240-9834-cd7fb98993d2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:03.753036 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ee9b2166-bd5c-4240-9834-cd7fb98993d2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.169466 May 28 17:28:03.753671 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 168/343] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:03 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:04.424294 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2a3e2677-706e-4566-9032-8df957d93023 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:04.425003 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2a3e2677-706e-4566-9032-8df957d93023 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:04.431545 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2a3e2677-706e-4566-9032-8df957d93023 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:04.431994 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2a3e2677-706e-4566-9032-8df957d93023 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:04.432805 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2a3e2677-706e-4566-9032-8df957d93023 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:04.433242 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2a3e2677-706e-4566-9032-8df957d93023 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:04.433764 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-68ce5965-fdf8-4201-9052-0cc63d280718 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:04.434378 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-68ce5965-fdf8-4201-9052-0cc63d280718 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:04.442200 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-68ce5965-fdf8-4201-9052-0cc63d280718 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:04.442658 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-68ce5965-fdf8-4201-9052-0cc63d280718 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:04.443564 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-68ce5965-fdf8-4201-9052-0cc63d280718 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:04.444009 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-68ce5965-fdf8-4201-9052-0cc63d280718 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:04.514355 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-2a3e2677-706e-4566-9032-8df957d93023 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:04.522677 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2a3e2677-706e-4566-9032-8df957d93023 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1266 microversion: 2.1 time: 0.104774 May 28 17:28:04.532958 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 176/344] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:04 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1266 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:04.600698 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-68ce5965-fdf8-4201-9052-0cc63d280718 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:04.608687 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-68ce5965-fdf8-4201-9052-0cc63d280718 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.178642 May 28 17:28:04.610063 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 169/345] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:04 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:04.770709 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1816f4f4-9233-4131-b1ac-468578b84560 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:04.771332 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1816f4f4-9233-4131-b1ac-468578b84560 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:04.777347 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1816f4f4-9233-4131-b1ac-468578b84560 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:04.778117 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1816f4f4-9233-4131-b1ac-468578b84560 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:04.779150 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1816f4f4-9233-4131-b1ac-468578b84560 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:04.779825 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1816f4f4-9233-4131-b1ac-468578b84560 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:04.959820 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1816f4f4-9233-4131-b1ac-468578b84560 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:04.973437 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1816f4f4-9233-4131-b1ac-468578b84560 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.206453 May 28 17:28:04.973923 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 177/346] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:04 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:05.541934 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0f571365-8971-4a4f-a52f-8c7d7f803b3f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:05.542702 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0f571365-8971-4a4f-a52f-8c7d7f803b3f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:05.550491 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0f571365-8971-4a4f-a52f-8c7d7f803b3f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:05.550932 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0f571365-8971-4a4f-a52f-8c7d7f803b3f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:05.551727 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0f571365-8971-4a4f-a52f-8c7d7f803b3f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:05.552184 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0f571365-8971-4a4f-a52f-8c7d7f803b3f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:05.612487 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0f571365-8971-4a4f-a52f-8c7d7f803b3f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:05.619796 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0f571365-8971-4a4f-a52f-8c7d7f803b3f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1266 microversion: 2.1 time: 0.082814 May 28 17:28:05.620364 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 170/347] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:05 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:05.626726 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6532824e-2d83-4919-a7f2-8b40c5f92647 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:05.627351 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6532824e-2d83-4919-a7f2-8b40c5f92647 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:05.633984 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6532824e-2d83-4919-a7f2-8b40c5f92647 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:05.634427 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6532824e-2d83-4919-a7f2-8b40c5f92647 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:05.635178 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6532824e-2d83-4919-a7f2-8b40c5f92647 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:05.635650 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6532824e-2d83-4919-a7f2-8b40c5f92647 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:05.763234 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6532824e-2d83-4919-a7f2-8b40c5f92647 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:05.771541 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6532824e-2d83-4919-a7f2-8b40c5f92647 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.149529 May 28 17:28:05.772099 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 178/348] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:05 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:05.989460 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6b8cb5df-b009-4fc4-8e44-076c4186db44 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:05.990115 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6b8cb5df-b009-4fc4-8e44-076c4186db44 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:05.996064 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6b8cb5df-b009-4fc4-8e44-076c4186db44 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:05.996509 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6b8cb5df-b009-4fc4-8e44-076c4186db44 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:05.997259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6b8cb5df-b009-4fc4-8e44-076c4186db44 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:05.997952 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6b8cb5df-b009-4fc4-8e44-076c4186db44 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:06.132681 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-6b8cb5df-b009-4fc4-8e44-076c4186db44 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:06.140002 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6b8cb5df-b009-4fc4-8e44-076c4186db44 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.154434 May 28 17:28:06.141189 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 171/349] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:05 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:06.637516 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b8436fcc-f663-4053-a8db-e920e40b1a98 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:06.638063 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b8436fcc-f663-4053-a8db-e920e40b1a98 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:06.644838 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b8436fcc-f663-4053-a8db-e920e40b1a98 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:06.645283 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b8436fcc-f663-4053-a8db-e920e40b1a98 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:06.646039 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b8436fcc-f663-4053-a8db-e920e40b1a98 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:06.646474 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b8436fcc-f663-4053-a8db-e920e40b1a98 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:06.709334 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b8436fcc-f663-4053-a8db-e920e40b1a98 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:06.716840 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b8436fcc-f663-4053-a8db-e920e40b1a98 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1266 microversion: 2.1 time: 0.083268 May 28 17:28:06.717407 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 179/350] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:06 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:06.788134 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-329c55b6-bad9-45e8-85df-27cac57a3058 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:06.788748 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-329c55b6-bad9-45e8-85df-27cac57a3058 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:06.795169 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-329c55b6-bad9-45e8-85df-27cac57a3058 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:06.795658 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-329c55b6-bad9-45e8-85df-27cac57a3058 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:06.796437 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-329c55b6-bad9-45e8-85df-27cac57a3058 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:06.796932 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-329c55b6-bad9-45e8-85df-27cac57a3058 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:06.923915 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-329c55b6-bad9-45e8-85df-27cac57a3058 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:06.931264 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-329c55b6-bad9-45e8-85df-27cac57a3058 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.146922 May 28 17:28:06.931855 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 172/351] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:06 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:07.157585 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d43ea417-4fb2-41d6-987e-8527881550f5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:07.158199 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d43ea417-4fb2-41d6-987e-8527881550f5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:07.164295 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d43ea417-4fb2-41d6-987e-8527881550f5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:07.164741 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d43ea417-4fb2-41d6-987e-8527881550f5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:07.165495 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d43ea417-4fb2-41d6-987e-8527881550f5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:07.165925 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d43ea417-4fb2-41d6-987e-8527881550f5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:07.295253 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d43ea417-4fb2-41d6-987e-8527881550f5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:07.303305 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d43ea417-4fb2-41d6-987e-8527881550f5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.149705 May 28 17:28:07.303884 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 180/352] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:07 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:07.733626 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f088499a-b437-4ccf-9e8b-9853bf495e81 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:07.735151 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f088499a-b437-4ccf-9e8b-9853bf495e81 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:07.741116 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f088499a-b437-4ccf-9e8b-9853bf495e81 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:07.741562 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f088499a-b437-4ccf-9e8b-9853bf495e81 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:07.742313 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f088499a-b437-4ccf-9e8b-9853bf495e81 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:07.742743 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f088499a-b437-4ccf-9e8b-9853bf495e81 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:07.802824 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f088499a-b437-4ccf-9e8b-9853bf495e81 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:07.804992 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=100 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:28:07.811423 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f088499a-b437-4ccf-9e8b-9853bf495e81 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1266 microversion: 2.1 time: 0.081539 May 28 17:28:07.811997 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 173/353] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:07 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:07.948794 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ebd7a12b-0170-4318-be1c-de6ad17a20a6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:07.949403 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ebd7a12b-0170-4318-be1c-de6ad17a20a6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:07.951732 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:28:07.958489 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ebd7a12b-0170-4318-be1c-de6ad17a20a6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:07.959003 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ebd7a12b-0170-4318-be1c-de6ad17a20a6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:07.959914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ebd7a12b-0170-4318-be1c-de6ad17a20a6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:07.960357 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ebd7a12b-0170-4318-be1c-de6ad17a20a6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:08.091793 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ebd7a12b-0170-4318-be1c-de6ad17a20a6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:08.099803 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ebd7a12b-0170-4318-be1c-de6ad17a20a6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.154893 May 28 17:28:08.100357 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 181/354] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:07 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:08.320977 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8b154c17-01db-438e-a09d-94c940e492ec tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:08.321584 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8b154c17-01db-438e-a09d-94c940e492ec tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:08.328936 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8b154c17-01db-438e-a09d-94c940e492ec tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:08.329410 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8b154c17-01db-438e-a09d-94c940e492ec tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:08.330170 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8b154c17-01db-438e-a09d-94c940e492ec tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:08.330605 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8b154c17-01db-438e-a09d-94c940e492ec tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:08.461491 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8b154c17-01db-438e-a09d-94c940e492ec tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:08.469318 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8b154c17-01db-438e-a09d-94c940e492ec tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.152035 May 28 17:28:08.469875 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 174/355] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:08 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:08.828887 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-238fcfd5-a8d0-4da4-9128-85cce1cf7b16 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:08.829490 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-238fcfd5-a8d0-4da4-9128-85cce1cf7b16 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:08.835481 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-238fcfd5-a8d0-4da4-9128-85cce1cf7b16 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:08.835928 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-238fcfd5-a8d0-4da4-9128-85cce1cf7b16 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:08.836675 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-238fcfd5-a8d0-4da4-9128-85cce1cf7b16 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:08.837109 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-238fcfd5-a8d0-4da4-9128-85cce1cf7b16 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:08.898251 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-238fcfd5-a8d0-4da4-9128-85cce1cf7b16 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:08.905523 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-238fcfd5-a8d0-4da4-9128-85cce1cf7b16 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1266 microversion: 2.1 time: 0.080713 May 28 17:28:08.906226 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 182/356] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:08 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:09.116147 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a23c00bd-9b84-44e3-83ea-cee7137117ca tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:09.116706 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a23c00bd-9b84-44e3-83ea-cee7137117ca tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:09.123475 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a23c00bd-9b84-44e3-83ea-cee7137117ca tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:09.123923 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a23c00bd-9b84-44e3-83ea-cee7137117ca tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:09.125198 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a23c00bd-9b84-44e3-83ea-cee7137117ca tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:09.125644 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a23c00bd-9b84-44e3-83ea-cee7137117ca tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:09.251946 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a23c00bd-9b84-44e3-83ea-cee7137117ca tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:09.259192 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a23c00bd-9b84-44e3-83ea-cee7137117ca tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.146943 May 28 17:28:09.259784 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 175/357] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:09 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:09.486499 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4963c039-74ef-4257-993c-631e77404c55 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:09.487103 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-4963c039-74ef-4257-993c-631e77404c55 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:09.493502 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4963c039-74ef-4257-993c-631e77404c55 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:09.493940 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4963c039-74ef-4257-993c-631e77404c55 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:09.494685 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4963c039-74ef-4257-993c-631e77404c55 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:09.495118 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4963c039-74ef-4257-993c-631e77404c55 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:09.625414 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-4963c039-74ef-4257-993c-631e77404c55 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:09.633099 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-4963c039-74ef-4257-993c-631e77404c55 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.151171 May 28 17:28:09.633665 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 183/358] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:09 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:09.925640 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ca9dd2f1-b6ba-44dd-b49b-d2871d693596 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:09.926834 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ca9dd2f1-b6ba-44dd-b49b-d2871d693596 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:09.933111 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ca9dd2f1-b6ba-44dd-b49b-d2871d693596 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:09.933563 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ca9dd2f1-b6ba-44dd-b49b-d2871d693596 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:09.934326 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ca9dd2f1-b6ba-44dd-b49b-d2871d693596 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:09.934765 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ca9dd2f1-b6ba-44dd-b49b-d2871d693596 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:09.999126 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ca9dd2f1-b6ba-44dd-b49b-d2871d693596 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:10.007092 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ca9dd2f1-b6ba-44dd-b49b-d2871d693596 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1266 microversion: 2.1 time: 0.085411 May 28 17:28:10.007681 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 176/359] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:09 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:10.277172 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-988da407-92b7-49df-b32c-3e2af74d6de8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:10.277700 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-988da407-92b7-49df-b32c-3e2af74d6de8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:10.283889 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-988da407-92b7-49df-b32c-3e2af74d6de8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:10.284337 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-988da407-92b7-49df-b32c-3e2af74d6de8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:10.285121 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-988da407-92b7-49df-b32c-3e2af74d6de8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:10.285565 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-988da407-92b7-49df-b32c-3e2af74d6de8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:10.417786 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-988da407-92b7-49df-b32c-3e2af74d6de8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:10.425950 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-988da407-92b7-49df-b32c-3e2af74d6de8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.152793 May 28 17:28:10.426519 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 184/360] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:10 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:10.649285 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0acec97e-a98f-4ad4-9557-6d8242b59e01 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:10.649834 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0acec97e-a98f-4ad4-9557-6d8242b59e01 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:10.656956 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0acec97e-a98f-4ad4-9557-6d8242b59e01 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:10.657407 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0acec97e-a98f-4ad4-9557-6d8242b59e01 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:10.658155 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0acec97e-a98f-4ad4-9557-6d8242b59e01 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:10.658590 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0acec97e-a98f-4ad4-9557-6d8242b59e01 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:10.784704 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0acec97e-a98f-4ad4-9557-6d8242b59e01 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:10.791939 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0acec97e-a98f-4ad4-9557-6d8242b59e01 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.146596 May 28 17:28:10.792499 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 177/361] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:10 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:11.025498 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-858e050d-e504-4c50-a1c6-774b1ae08100 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:11.026168 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-858e050d-e504-4c50-a1c6-774b1ae08100 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:11.033347 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-858e050d-e504-4c50-a1c6-774b1ae08100 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:11.033861 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-858e050d-e504-4c50-a1c6-774b1ae08100 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:11.034636 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-858e050d-e504-4c50-a1c6-774b1ae08100 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:11.035073 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-858e050d-e504-4c50-a1c6-774b1ae08100 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:11.124648 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-858e050d-e504-4c50-a1c6-774b1ae08100 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:11.133576 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-858e050d-e504-4c50-a1c6-774b1ae08100 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1274 microversion: 2.1 time: 0.111917 May 28 17:28:11.134177 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 185/362] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:11 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1274 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:11.443545 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-fc6ea26a-8cf8-48ea-881d-4ecf74699e10 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:11.444168 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-fc6ea26a-8cf8-48ea-881d-4ecf74699e10 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:11.450688 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fc6ea26a-8cf8-48ea-881d-4ecf74699e10 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:11.451144 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fc6ea26a-8cf8-48ea-881d-4ecf74699e10 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:11.451977 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fc6ea26a-8cf8-48ea-881d-4ecf74699e10 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:11.452418 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fc6ea26a-8cf8-48ea-881d-4ecf74699e10 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:11.589365 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-fc6ea26a-8cf8-48ea-881d-4ecf74699e10 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:11.597557 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-fc6ea26a-8cf8-48ea-881d-4ecf74699e10 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.157984 May 28 17:28:11.598138 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 178/363] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:11 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:11.809741 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2dd549d8-0963-46a3-bbf5-558ba3eda7ca tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:11.810476 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2dd549d8-0963-46a3-bbf5-558ba3eda7ca tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:11.822912 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2dd549d8-0963-46a3-bbf5-558ba3eda7ca tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:11.823551 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2dd549d8-0963-46a3-bbf5-558ba3eda7ca tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:11.824613 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2dd549d8-0963-46a3-bbf5-558ba3eda7ca tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:11.826847 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2dd549d8-0963-46a3-bbf5-558ba3eda7ca tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:12.005279 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-c0bac1b0-5a29-4ada-8e6e-937c4a70df46 req-44ea79ec-6e64-4655-841f-245a990285f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c454eafd-57ce-466c-a88f-aa88a272a56a", "tag": "f6092e8b-c7e1-4c14-a7b3-8baa64e42a95"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:28:12.024590 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-c0bac1b0-5a29-4ada-8e6e-937c4a70df46 req-44ea79ec-6e64-4655-841f-245a990285f9 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:12.025229 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-c0bac1b0-5a29-4ada-8e6e-937c4a70df46 req-44ea79ec-6e64-4655-841f-245a990285f9 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:12.041693 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-c0bac1b0-5a29-4ada-8e6e-937c4a70df46 req-44ea79ec-6e64-4655-841f-245a990285f9 service nova] Creating event network-changed:f6092e8b-c7e1-4c14-a7b3-8baa64e42a95 for instance c454eafd-57ce-466c-a88f-aa88a272a56a on hv-cinder-84372 May 28 17:28:12.047291 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-c0bac1b0-5a29-4ada-8e6e-937c4a70df46 req-44ea79ec-6e64-4655-841f-245a990285f9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045664 May 28 17:28:12.048368 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 179/364] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:28:12.077585 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-2dd549d8-0963-46a3-bbf5-558ba3eda7ca tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:12.086540 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2dd549d8-0963-46a3-bbf5-558ba3eda7ca tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.280818 May 28 17:28:12.087286 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 186/365] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:11 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:12.152121 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b72afa42-f4de-4a36-aeda-fbd671650c7f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:12.152934 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-b72afa42-f4de-4a36-aeda-fbd671650c7f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:12.160044 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b72afa42-f4de-4a36-aeda-fbd671650c7f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:12.160579 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b72afa42-f4de-4a36-aeda-fbd671650c7f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:12.161432 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b72afa42-f4de-4a36-aeda-fbd671650c7f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:12.161874 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b72afa42-f4de-4a36-aeda-fbd671650c7f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:12.229367 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b72afa42-f4de-4a36-aeda-fbd671650c7f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:12.236927 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b72afa42-f4de-4a36-aeda-fbd671650c7f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1272 microversion: 2.1 time: 0.088994 May 28 17:28:12.237494 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 180/366] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:12 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1272 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:12.614659 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-bd72b95a-5ab2-4293-8f86-bf62dcfbf1b0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:12.615562 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-bd72b95a-5ab2-4293-8f86-bf62dcfbf1b0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:12.621951 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bd72b95a-5ab2-4293-8f86-bf62dcfbf1b0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:12.622796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bd72b95a-5ab2-4293-8f86-bf62dcfbf1b0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:12.623739 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bd72b95a-5ab2-4293-8f86-bf62dcfbf1b0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:12.624300 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bd72b95a-5ab2-4293-8f86-bf62dcfbf1b0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:12.788817 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-bd72b95a-5ab2-4293-8f86-bf62dcfbf1b0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:12.800211 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-bd72b95a-5ab2-4293-8f86-bf62dcfbf1b0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.189544 May 28 17:28:12.800791 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 187/367] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:12 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:13.104162 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-21783912-290d-4308-a394-42e823eea52a tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:13.104702 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-21783912-290d-4308-a394-42e823eea52a tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:13.115132 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-21783912-290d-4308-a394-42e823eea52a tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:13.115605 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-21783912-290d-4308-a394-42e823eea52a tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:13.116439 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-21783912-290d-4308-a394-42e823eea52a tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:13.116875 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-21783912-290d-4308-a394-42e823eea52a tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:13.255028 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-06f3c157-3dd0-4d4d-95a3-7fcd0d314f3c tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:13.255824 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-06f3c157-3dd0-4d4d-95a3-7fcd0d314f3c tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:13.262368 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-06f3c157-3dd0-4d4d-95a3-7fcd0d314f3c tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:13.262930 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-06f3c157-3dd0-4d4d-95a3-7fcd0d314f3c tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:13.263848 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-06f3c157-3dd0-4d4d-95a3-7fcd0d314f3c tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:13.264360 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-06f3c157-3dd0-4d4d-95a3-7fcd0d314f3c tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:13.338733 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-21783912-290d-4308-a394-42e823eea52a tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:13.347055 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-21783912-290d-4308-a394-42e823eea52a tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.247659 May 28 17:28:13.347676 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 181/368] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:13 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:13.400649 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-06f3c157-3dd0-4d4d-95a3-7fcd0d314f3c tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:13.402886 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=100 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:28:13.410026 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-06f3c157-3dd0-4d4d-95a3-7fcd0d314f3c tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1314 microversion: 2.1 time: 0.159194 May 28 17:28:13.410590 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 188/369] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:13 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:13.816830 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7a4ffbe8-8d69-472f-aeed-24bd3a632768 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:13.817456 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7a4ffbe8-8d69-472f-aeed-24bd3a632768 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:13.823671 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7a4ffbe8-8d69-472f-aeed-24bd3a632768 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:13.824123 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7a4ffbe8-8d69-472f-aeed-24bd3a632768 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:13.824892 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7a4ffbe8-8d69-472f-aeed-24bd3a632768 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:13.825332 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7a4ffbe8-8d69-472f-aeed-24bd3a632768 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:13.971969 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7a4ffbe8-8d69-472f-aeed-24bd3a632768 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:13.980640 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7a4ffbe8-8d69-472f-aeed-24bd3a632768 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.168237 May 28 17:28:13.981203 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 182/370] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:13 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:14.363389 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-bba4310a-e65d-47aa-ba51-2e35642e3d93 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:14.363996 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-bba4310a-e65d-47aa-ba51-2e35642e3d93 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:14.370651 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bba4310a-e65d-47aa-ba51-2e35642e3d93 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:14.371095 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bba4310a-e65d-47aa-ba51-2e35642e3d93 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:14.371873 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bba4310a-e65d-47aa-ba51-2e35642e3d93 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:14.372304 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bba4310a-e65d-47aa-ba51-2e35642e3d93 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:14.426093 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-228ef6c8-70f9-45c5-bce8-692e6c07042d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:14.426753 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-228ef6c8-70f9-45c5-bce8-692e6c07042d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:14.433310 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-228ef6c8-70f9-45c5-bce8-692e6c07042d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:14.434427 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-228ef6c8-70f9-45c5-bce8-692e6c07042d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:14.434549 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-228ef6c8-70f9-45c5-bce8-692e6c07042d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:14.434949 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-228ef6c8-70f9-45c5-bce8-692e6c07042d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:14.513146 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-bba4310a-e65d-47aa-ba51-2e35642e3d93 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:14.521673 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-bba4310a-e65d-47aa-ba51-2e35642e3d93 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.162200 May 28 17:28:14.522240 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 189/371] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:14 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:14.572164 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-228ef6c8-70f9-45c5-bce8-692e6c07042d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:14.581794 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-228ef6c8-70f9-45c5-bce8-692e6c07042d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1314 microversion: 2.1 time: 0.159581 May 28 17:28:14.582720 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 183/372] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:14 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:14.999149 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-342a7342-0710-4361-9b1b-c40cbcf5d0ff tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:14.999920 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-342a7342-0710-4361-9b1b-c40cbcf5d0ff tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:15.008812 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-342a7342-0710-4361-9b1b-c40cbcf5d0ff tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:15.009271 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-342a7342-0710-4361-9b1b-c40cbcf5d0ff tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:15.010196 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-342a7342-0710-4361-9b1b-c40cbcf5d0ff tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:15.010639 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-342a7342-0710-4361-9b1b-c40cbcf5d0ff tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:15.174118 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-342a7342-0710-4361-9b1b-c40cbcf5d0ff tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:15.183242 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-342a7342-0710-4361-9b1b-c40cbcf5d0ff tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.187786 May 28 17:28:15.184088 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 190/373] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:14 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:15.359571 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-e8ea4c6c-7ac4-43d3-8103-04a7d370e255 req-422ed2d0-7dc3-4c70-adc8-93f564b8573b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d039398-7bb2-4301-8a49-b20879664453", "tag": "2fca81f6-5f66-480e-ad69-10b15eddf35a"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:28:15.367934 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-e8ea4c6c-7ac4-43d3-8103-04a7d370e255 req-422ed2d0-7dc3-4c70-adc8-93f564b8573b service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:15.368380 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-e8ea4c6c-7ac4-43d3-8103-04a7d370e255 req-422ed2d0-7dc3-4c70-adc8-93f564b8573b service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:15.380285 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-e8ea4c6c-7ac4-43d3-8103-04a7d370e255 req-422ed2d0-7dc3-4c70-adc8-93f564b8573b service nova] Creating event network-changed:2fca81f6-5f66-480e-ad69-10b15eddf35a for instance 4d039398-7bb2-4301-8a49-b20879664453 on hv-cinder-84372 May 28 17:28:15.384885 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-e8ea4c6c-7ac4-43d3-8103-04a7d370e255 req-422ed2d0-7dc3-4c70-adc8-93f564b8573b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029108 May 28 17:28:15.385476 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 184/374] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:28:15.538095 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f49221de-d294-4df7-b92d-2007b6d20b7a tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:15.538631 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f49221de-d294-4df7-b92d-2007b6d20b7a tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:15.546034 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f49221de-d294-4df7-b92d-2007b6d20b7a tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:15.546526 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f49221de-d294-4df7-b92d-2007b6d20b7a tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:15.547304 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f49221de-d294-4df7-b92d-2007b6d20b7a tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:15.547783 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f49221de-d294-4df7-b92d-2007b6d20b7a tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:15.599741 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ccd91a25-a7c8-46eb-9cd2-8ef151303a40 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:15.600433 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ccd91a25-a7c8-46eb-9cd2-8ef151303a40 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:15.606932 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ccd91a25-a7c8-46eb-9cd2-8ef151303a40 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:15.607404 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ccd91a25-a7c8-46eb-9cd2-8ef151303a40 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:15.608163 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ccd91a25-a7c8-46eb-9cd2-8ef151303a40 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:15.608598 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ccd91a25-a7c8-46eb-9cd2-8ef151303a40 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:15.678066 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f49221de-d294-4df7-b92d-2007b6d20b7a tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:15.685469 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f49221de-d294-4df7-b92d-2007b6d20b7a tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.151355 May 28 17:28:15.686044 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 191/375] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:15 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:15.742952 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ccd91a25-a7c8-46eb-9cd2-8ef151303a40 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:15.751250 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ccd91a25-a7c8-46eb-9cd2-8ef151303a40 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1314 microversion: 2.1 time: 0.155648 May 28 17:28:15.751838 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 185/376] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:15 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:16.200504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d55ff041-472b-4073-b199-25f4c3fd848b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:16.201114 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d55ff041-472b-4073-b199-25f4c3fd848b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:16.207839 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d55ff041-472b-4073-b199-25f4c3fd848b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:16.208284 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d55ff041-472b-4073-b199-25f4c3fd848b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:16.209047 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d55ff041-472b-4073-b199-25f4c3fd848b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:16.209477 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d55ff041-472b-4073-b199-25f4c3fd848b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:16.334328 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d55ff041-472b-4073-b199-25f4c3fd848b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:16.341601 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d55ff041-472b-4073-b199-25f4c3fd848b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.145058 May 28 17:28:16.342156 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 192/377] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:16 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:16.702150 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-76842e2b-f22e-4e1f-bc26-e57a08e8fcc7 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:16.703496 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-76842e2b-f22e-4e1f-bc26-e57a08e8fcc7 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:16.710334 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-76842e2b-f22e-4e1f-bc26-e57a08e8fcc7 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:16.710789 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-76842e2b-f22e-4e1f-bc26-e57a08e8fcc7 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:16.711615 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-76842e2b-f22e-4e1f-bc26-e57a08e8fcc7 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:16.712037 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-76842e2b-f22e-4e1f-bc26-e57a08e8fcc7 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:16.768563 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5f02b93f-3798-4ae0-b871-07719835cb2b tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:16.769169 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5f02b93f-3798-4ae0-b871-07719835cb2b tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:16.775655 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5f02b93f-3798-4ae0-b871-07719835cb2b tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:16.776101 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5f02b93f-3798-4ae0-b871-07719835cb2b tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:16.777631 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5f02b93f-3798-4ae0-b871-07719835cb2b tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:16.778067 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5f02b93f-3798-4ae0-b871-07719835cb2b tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:16.849485 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-76842e2b-f22e-4e1f-bc26-e57a08e8fcc7 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:16.856834 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-76842e2b-f22e-4e1f-bc26-e57a08e8fcc7 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.158603 May 28 17:28:16.857393 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 186/378] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:16 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:16.908443 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5f02b93f-3798-4ae0-b871-07719835cb2b tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:16.915746 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5f02b93f-3798-4ae0-b871-07719835cb2b tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1314 microversion: 2.1 time: 0.151320 May 28 17:28:16.916311 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 193/379] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:16 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:17.358536 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8fcc981f-37f9-456b-8bcf-b028f2973cc2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:17.359291 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8fcc981f-37f9-456b-8bcf-b028f2973cc2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:17.367308 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8fcc981f-37f9-456b-8bcf-b028f2973cc2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:17.367880 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8fcc981f-37f9-456b-8bcf-b028f2973cc2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:17.368804 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8fcc981f-37f9-456b-8bcf-b028f2973cc2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:17.369245 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8fcc981f-37f9-456b-8bcf-b028f2973cc2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:17.506983 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8fcc981f-37f9-456b-8bcf-b028f2973cc2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:17.514297 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8fcc981f-37f9-456b-8bcf-b028f2973cc2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.159753 May 28 17:28:17.514852 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 187/380] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:17 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:17.875357 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6df1dd52-8a9c-4450-9565-850f33b3cbf7 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:17.875960 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6df1dd52-8a9c-4450-9565-850f33b3cbf7 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:17.882417 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6df1dd52-8a9c-4450-9565-850f33b3cbf7 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:17.882862 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6df1dd52-8a9c-4450-9565-850f33b3cbf7 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:17.883650 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6df1dd52-8a9c-4450-9565-850f33b3cbf7 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:17.884088 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6df1dd52-8a9c-4450-9565-850f33b3cbf7 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:17.933027 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-be5b597c-92fb-4701-93e6-c53be3ace0aa tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:17.933659 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-be5b597c-92fb-4701-93e6-c53be3ace0aa tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:17.940535 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-be5b597c-92fb-4701-93e6-c53be3ace0aa tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:17.940986 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-be5b597c-92fb-4701-93e6-c53be3ace0aa tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:17.941747 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-be5b597c-92fb-4701-93e6-c53be3ace0aa tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:17.942186 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-be5b597c-92fb-4701-93e6-c53be3ace0aa tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:18.009415 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6df1dd52-8a9c-4450-9565-850f33b3cbf7 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:18.017507 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6df1dd52-8a9c-4450-9565-850f33b3cbf7 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.146767 May 28 17:28:18.018304 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 194/381] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:17 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:18.081292 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-be5b597c-92fb-4701-93e6-c53be3ace0aa tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:18.088578 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-be5b597c-92fb-4701-93e6-c53be3ace0aa tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1314 microversion: 2.1 time: 0.159470 May 28 17:28:18.089133 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 188/382] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:17 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:18.533211 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-cfa4dc78-de54-48b5-a810-33123a693ddc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:18.534086 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-cfa4dc78-de54-48b5-a810-33123a693ddc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:18.540479 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cfa4dc78-de54-48b5-a810-33123a693ddc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:18.541245 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cfa4dc78-de54-48b5-a810-33123a693ddc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:18.542126 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cfa4dc78-de54-48b5-a810-33123a693ddc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:18.542599 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cfa4dc78-de54-48b5-a810-33123a693ddc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:18.782113 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-cfa4dc78-de54-48b5-a810-33123a693ddc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:18.789611 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-cfa4dc78-de54-48b5-a810-33123a693ddc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.261461 May 28 17:28:18.790118 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 195/383] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:18 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:19.034676 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-cdd7fe50-9f08-425e-b0fa-a73953f9bdb6 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:19.035465 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-cdd7fe50-9f08-425e-b0fa-a73953f9bdb6 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:19.042029 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cdd7fe50-9f08-425e-b0fa-a73953f9bdb6 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:19.042422 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cdd7fe50-9f08-425e-b0fa-a73953f9bdb6 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:19.043279 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cdd7fe50-9f08-425e-b0fa-a73953f9bdb6 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:19.043739 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cdd7fe50-9f08-425e-b0fa-a73953f9bdb6 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:19.105896 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-78dfeace-1dbe-428f-9ad4-3c2849ad7967 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:19.106568 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-78dfeace-1dbe-428f-9ad4-3c2849ad7967 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:19.113470 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-78dfeace-1dbe-428f-9ad4-3c2849ad7967 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:19.113921 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-78dfeace-1dbe-428f-9ad4-3c2849ad7967 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:19.114683 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-78dfeace-1dbe-428f-9ad4-3c2849ad7967 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:19.115119 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-78dfeace-1dbe-428f-9ad4-3c2849ad7967 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:19.180260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-cdd7fe50-9f08-425e-b0fa-a73953f9bdb6 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:19.189094 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-cdd7fe50-9f08-425e-b0fa-a73953f9bdb6 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.158872 May 28 17:28:19.189672 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 189/384] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:19 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:19.257276 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-78dfeace-1dbe-428f-9ad4-3c2849ad7967 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:19.264687 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-78dfeace-1dbe-428f-9ad4-3c2849ad7967 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1314 microversion: 2.1 time: 0.162679 May 28 17:28:19.265911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 196/385] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:19 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:19.805984 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-61b45b14-552b-459d-891f-9974f020f43b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:19.806598 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-61b45b14-552b-459d-891f-9974f020f43b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:19.813506 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-61b45b14-552b-459d-891f-9974f020f43b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:19.813962 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-61b45b14-552b-459d-891f-9974f020f43b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:19.814724 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-61b45b14-552b-459d-891f-9974f020f43b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:19.815165 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-61b45b14-552b-459d-891f-9974f020f43b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:19.945979 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-61b45b14-552b-459d-891f-9974f020f43b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:19.953347 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-61b45b14-552b-459d-891f-9974f020f43b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.151303 May 28 17:28:19.953944 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 190/386] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:19 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:20.206689 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2ca4a641-9a8b-4d76-bdad-08c3412e73a8 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:20.207292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2ca4a641-9a8b-4d76-bdad-08c3412e73a8 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:20.213275 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2ca4a641-9a8b-4d76-bdad-08c3412e73a8 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:20.213743 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2ca4a641-9a8b-4d76-bdad-08c3412e73a8 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:20.214489 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2ca4a641-9a8b-4d76-bdad-08c3412e73a8 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:20.214919 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2ca4a641-9a8b-4d76-bdad-08c3412e73a8 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:20.283588 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7939b5e1-f145-44d0-bac1-da026b0cbe41 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:20.284215 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7939b5e1-f145-44d0-bac1-da026b0cbe41 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:20.290606 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7939b5e1-f145-44d0-bac1-da026b0cbe41 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:20.291051 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7939b5e1-f145-44d0-bac1-da026b0cbe41 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:20.291837 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7939b5e1-f145-44d0-bac1-da026b0cbe41 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:20.292271 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7939b5e1-f145-44d0-bac1-da026b0cbe41 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:20.346454 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-2ca4a641-9a8b-4d76-bdad-08c3412e73a8 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:20.354160 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2ca4a641-9a8b-4d76-bdad-08c3412e73a8 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.151733 May 28 17:28:20.354736 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 197/387] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:20 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:20.425981 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7939b5e1-f145-44d0-bac1-da026b0cbe41 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:20.428258 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=100 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:28:20.435099 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7939b5e1-f145-44d0-bac1-da026b0cbe41 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1314 microversion: 2.1 time: 0.156999 May 28 17:28:20.435747 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 191/388] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:20 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:20.971474 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-bb84bc45-3bad-414f-b5a3-00b411366613 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:20.971922 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-bb84bc45-3bad-414f-b5a3-00b411366613 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:20.978246 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bb84bc45-3bad-414f-b5a3-00b411366613 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:20.978694 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bb84bc45-3bad-414f-b5a3-00b411366613 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:20.979492 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bb84bc45-3bad-414f-b5a3-00b411366613 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:20.980118 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bb84bc45-3bad-414f-b5a3-00b411366613 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:21.130571 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-bb84bc45-3bad-414f-b5a3-00b411366613 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:21.138722 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-bb84bc45-3bad-414f-b5a3-00b411366613 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.172184 May 28 17:28:21.139318 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 198/389] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:20 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:21.371682 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-46485ba3-e3e5-4b9e-8444-f4e5e603ea7d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:21.372218 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-46485ba3-e3e5-4b9e-8444-f4e5e603ea7d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:21.378975 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-46485ba3-e3e5-4b9e-8444-f4e5e603ea7d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:21.379467 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-46485ba3-e3e5-4b9e-8444-f4e5e603ea7d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:21.380227 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-46485ba3-e3e5-4b9e-8444-f4e5e603ea7d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:21.380663 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-46485ba3-e3e5-4b9e-8444-f4e5e603ea7d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:21.453018 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0971f0ab-7158-4b5f-a28c-fc0c80411677 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:21.453757 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0971f0ab-7158-4b5f-a28c-fc0c80411677 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:21.459877 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0971f0ab-7158-4b5f-a28c-fc0c80411677 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:21.460333 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0971f0ab-7158-4b5f-a28c-fc0c80411677 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:21.461100 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0971f0ab-7158-4b5f-a28c-fc0c80411677 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:21.461538 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0971f0ab-7158-4b5f-a28c-fc0c80411677 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:21.508725 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-46485ba3-e3e5-4b9e-8444-f4e5e603ea7d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:21.516943 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-46485ba3-e3e5-4b9e-8444-f4e5e603ea7d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.149319 May 28 17:28:21.517508 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 192/390] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:21 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:21.591195 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0971f0ab-7158-4b5f-a28c-fc0c80411677 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:21.599076 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0971f0ab-7158-4b5f-a28c-fc0c80411677 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1314 microversion: 2.1 time: 0.150461 May 28 17:28:21.599680 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 199/391] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:21 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:22.156896 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d2d96f0e-9edf-417c-9b4f-a059bb37b74d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:22.157511 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d2d96f0e-9edf-417c-9b4f-a059bb37b74d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:22.163485 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d2d96f0e-9edf-417c-9b4f-a059bb37b74d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:22.163939 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d2d96f0e-9edf-417c-9b4f-a059bb37b74d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:22.164705 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d2d96f0e-9edf-417c-9b4f-a059bb37b74d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:22.165143 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d2d96f0e-9edf-417c-9b4f-a059bb37b74d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:22.299574 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d2d96f0e-9edf-417c-9b4f-a059bb37b74d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:22.306990 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d2d96f0e-9edf-417c-9b4f-a059bb37b74d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.154183 May 28 17:28:22.307593 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 193/392] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:22 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:22.533859 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-07210ca8-2bf6-4e84-9b81-db05927d98e9 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:22.534409 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-07210ca8-2bf6-4e84-9b81-db05927d98e9 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:22.540956 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-07210ca8-2bf6-4e84-9b81-db05927d98e9 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:22.541497 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-07210ca8-2bf6-4e84-9b81-db05927d98e9 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:22.542625 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-07210ca8-2bf6-4e84-9b81-db05927d98e9 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:22.543395 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-07210ca8-2bf6-4e84-9b81-db05927d98e9 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:22.616204 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e212f903-ecf3-4455-a173-e1b9457a2651 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:22.616813 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-e212f903-ecf3-4455-a173-e1b9457a2651 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:22.623670 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e212f903-ecf3-4455-a173-e1b9457a2651 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:22.624118 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e212f903-ecf3-4455-a173-e1b9457a2651 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:22.624908 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e212f903-ecf3-4455-a173-e1b9457a2651 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:22.625345 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e212f903-ecf3-4455-a173-e1b9457a2651 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:22.675725 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-07210ca8-2bf6-4e84-9b81-db05927d98e9 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:22.683113 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-07210ca8-2bf6-4e84-9b81-db05927d98e9 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.153990 May 28 17:28:22.683701 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 200/393] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:22 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:22.757165 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-e212f903-ecf3-4455-a173-e1b9457a2651 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:22.764531 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-e212f903-ecf3-4455-a173-e1b9457a2651 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1314 microversion: 2.1 time: 0.152161 May 28 17:28:22.772236 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 194/394] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:22 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:23.324448 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-7321e431-3c3a-4b97-8904-a7b3207257af tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:23.325054 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-7321e431-3c3a-4b97-8904-a7b3207257af tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:23.332177 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7321e431-3c3a-4b97-8904-a7b3207257af tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:23.332619 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7321e431-3c3a-4b97-8904-a7b3207257af tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:23.333368 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7321e431-3c3a-4b97-8904-a7b3207257af tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:23.333799 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7321e431-3c3a-4b97-8904-a7b3207257af tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:23.464112 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7321e431-3c3a-4b97-8904-a7b3207257af tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:23.472145 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-7321e431-3c3a-4b97-8904-a7b3207257af tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.151539 May 28 17:28:23.472708 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 201/395] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:23 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:23.700135 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1890bad6-ed75-46a7-825f-a4930909493a tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:23.700753 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1890bad6-ed75-46a7-825f-a4930909493a tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:23.707278 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1890bad6-ed75-46a7-825f-a4930909493a tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:23.707825 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1890bad6-ed75-46a7-825f-a4930909493a tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:23.708583 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1890bad6-ed75-46a7-825f-a4930909493a tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:23.709019 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1890bad6-ed75-46a7-825f-a4930909493a tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:23.782349 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-19b8c073-8ae0-453f-98b9-3e9bdf73aeba tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:23.782965 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-19b8c073-8ae0-453f-98b9-3e9bdf73aeba tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:23.789574 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-19b8c073-8ae0-453f-98b9-3e9bdf73aeba tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:23.790018 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-19b8c073-8ae0-453f-98b9-3e9bdf73aeba tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:23.790776 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-19b8c073-8ae0-453f-98b9-3e9bdf73aeba tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:23.791208 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-19b8c073-8ae0-453f-98b9-3e9bdf73aeba tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:23.845237 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1890bad6-ed75-46a7-825f-a4930909493a tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:23.852600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1890bad6-ed75-46a7-825f-a4930909493a tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.156259 May 28 17:28:23.853172 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 195/396] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:23 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:23.917649 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-19b8c073-8ae0-453f-98b9-3e9bdf73aeba tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:23.925534 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-19b8c073-8ae0-453f-98b9-3e9bdf73aeba tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1314 microversion: 2.1 time: 0.147395 May 28 17:28:23.926096 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 202/397] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:23 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:24.489279 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b912a551-0e0a-46bb-b1b7-073888125861 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:24.489927 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-b912a551-0e0a-46bb-b1b7-073888125861 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:24.496210 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b912a551-0e0a-46bb-b1b7-073888125861 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:24.496669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b912a551-0e0a-46bb-b1b7-073888125861 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:24.497438 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b912a551-0e0a-46bb-b1b7-073888125861 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:24.498145 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b912a551-0e0a-46bb-b1b7-073888125861 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:24.629461 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b912a551-0e0a-46bb-b1b7-073888125861 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:24.644437 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b912a551-0e0a-46bb-b1b7-073888125861 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.158783 May 28 17:28:24.645693 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 196/398] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:24 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:24.869923 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-aa1547f1-e707-432d-8ae0-8abaa57ee0ec tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:24.870466 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-aa1547f1-e707-432d-8ae0-8abaa57ee0ec tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:24.877677 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aa1547f1-e707-432d-8ae0-8abaa57ee0ec tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:24.878121 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aa1547f1-e707-432d-8ae0-8abaa57ee0ec tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:24.878876 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aa1547f1-e707-432d-8ae0-8abaa57ee0ec tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:24.879312 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aa1547f1-e707-432d-8ae0-8abaa57ee0ec tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:24.942470 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7408a5e3-154d-4f6f-8569-9e05018364db tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:24.943112 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7408a5e3-154d-4f6f-8569-9e05018364db tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:24.949428 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7408a5e3-154d-4f6f-8569-9e05018364db tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:24.949874 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7408a5e3-154d-4f6f-8569-9e05018364db tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:24.950640 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7408a5e3-154d-4f6f-8569-9e05018364db tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:24.951072 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7408a5e3-154d-4f6f-8569-9e05018364db tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:25.010783 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-aa1547f1-e707-432d-8ae0-8abaa57ee0ec tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:25.018842 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-aa1547f1-e707-432d-8ae0-8abaa57ee0ec tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.152811 May 28 17:28:25.019629 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 203/399] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:24 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:25.081247 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7408a5e3-154d-4f6f-8569-9e05018364db tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:25.088593 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7408a5e3-154d-4f6f-8569-9e05018364db tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1314 microversion: 2.1 time: 0.149978 May 28 17:28:25.089159 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 197/400] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:24 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:25.663872 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-10da07a0-adf3-471f-858c-47e5978cf7f3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:25.664495 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-10da07a0-adf3-471f-858c-47e5978cf7f3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:25.671115 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-10da07a0-adf3-471f-858c-47e5978cf7f3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:25.672238 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-10da07a0-adf3-471f-858c-47e5978cf7f3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:25.673000 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-10da07a0-adf3-471f-858c-47e5978cf7f3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:25.673442 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-10da07a0-adf3-471f-858c-47e5978cf7f3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:25.806412 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-10da07a0-adf3-471f-858c-47e5978cf7f3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:25.816596 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-10da07a0-adf3-471f-858c-47e5978cf7f3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.156699 May 28 17:28:25.824554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 204/401] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:25 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:26.036108 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9521e536-a501-40a6-acd8-de639ff2034d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:26.036718 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9521e536-a501-40a6-acd8-de639ff2034d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:26.044673 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9521e536-a501-40a6-acd8-de639ff2034d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:26.045118 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9521e536-a501-40a6-acd8-de639ff2034d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:26.045883 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9521e536-a501-40a6-acd8-de639ff2034d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:26.046816 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9521e536-a501-40a6-acd8-de639ff2034d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:26.104866 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-485f60bf-bc87-41e9-b765-b029fa6b5052 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:26.105519 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-485f60bf-bc87-41e9-b765-b029fa6b5052 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:26.113512 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-485f60bf-bc87-41e9-b765-b029fa6b5052 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:26.113959 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-485f60bf-bc87-41e9-b765-b029fa6b5052 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:26.114717 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-485f60bf-bc87-41e9-b765-b029fa6b5052 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:26.115151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-485f60bf-bc87-41e9-b765-b029fa6b5052 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:26.130764 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=100 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:28:26.188452 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-9521e536-a501-40a6-acd8-de639ff2034d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:26.195826 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9521e536-a501-40a6-acd8-de639ff2034d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.163648 May 28 17:28:26.196467 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 198/402] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:26 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:26.247322 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-485f60bf-bc87-41e9-b765-b029fa6b5052 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:26.254939 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-485f60bf-bc87-41e9-b765-b029fa6b5052 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1314 microversion: 2.1 time: 0.153999 May 28 17:28:26.255520 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 205/403] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:26 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:26.832229 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9602427f-fee1-4222-9002-0c0a829522fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:26.832844 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9602427f-fee1-4222-9002-0c0a829522fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:26.838831 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9602427f-fee1-4222-9002-0c0a829522fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:26.839282 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9602427f-fee1-4222-9002-0c0a829522fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:26.840072 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9602427f-fee1-4222-9002-0c0a829522fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:26.840510 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9602427f-fee1-4222-9002-0c0a829522fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:26.966693 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-9602427f-fee1-4222-9002-0c0a829522fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:26.974233 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9602427f-fee1-4222-9002-0c0a829522fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.146398 May 28 17:28:26.974758 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 199/404] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:26 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:27.211943 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4dd6dd5a-a962-4a8e-950d-8d14fa05dc7c tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:27.212595 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-4dd6dd5a-a962-4a8e-950d-8d14fa05dc7c tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:27.219097 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4dd6dd5a-a962-4a8e-950d-8d14fa05dc7c tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:27.219636 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4dd6dd5a-a962-4a8e-950d-8d14fa05dc7c tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:27.220399 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4dd6dd5a-a962-4a8e-950d-8d14fa05dc7c tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:27.220839 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4dd6dd5a-a962-4a8e-950d-8d14fa05dc7c tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:27.272566 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4900af09-53df-4755-8a7a-46f42b6a6058 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:27.273107 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4900af09-53df-4755-8a7a-46f42b6a6058 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:27.279543 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4900af09-53df-4755-8a7a-46f42b6a6058 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:27.280001 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4900af09-53df-4755-8a7a-46f42b6a6058 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:27.280772 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4900af09-53df-4755-8a7a-46f42b6a6058 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:27.281213 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4900af09-53df-4755-8a7a-46f42b6a6058 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:27.346162 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-4dd6dd5a-a962-4a8e-950d-8d14fa05dc7c tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:27.353609 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-4dd6dd5a-a962-4a8e-950d-8d14fa05dc7c tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.145565 May 28 17:28:27.354184 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 206/405] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:27 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:27.412412 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4900af09-53df-4755-8a7a-46f42b6a6058 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:27.419828 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4900af09-53df-4755-8a7a-46f42b6a6058 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1314 microversion: 2.1 time: 0.151428 May 28 17:28:27.420409 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 200/406] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:27 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:27.990713 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-17156b6a-736d-48b1-ba9f-bab47f8dcb5d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:27.991262 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-17156b6a-736d-48b1-ba9f-bab47f8dcb5d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:27.997292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-17156b6a-736d-48b1-ba9f-bab47f8dcb5d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:27.997747 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-17156b6a-736d-48b1-ba9f-bab47f8dcb5d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:27.998762 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-17156b6a-736d-48b1-ba9f-bab47f8dcb5d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:27.999203 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-17156b6a-736d-48b1-ba9f-bab47f8dcb5d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:28.129573 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-17156b6a-736d-48b1-ba9f-bab47f8dcb5d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:28.137035 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-17156b6a-736d-48b1-ba9f-bab47f8dcb5d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.150201 May 28 17:28:28.137598 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 207/407] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:27 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:28.370843 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2b533daa-157b-443e-9548-e096485f39e3 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:28.371485 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2b533daa-157b-443e-9548-e096485f39e3 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:28.378143 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2b533daa-157b-443e-9548-e096485f39e3 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:28.378595 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2b533daa-157b-443e-9548-e096485f39e3 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:28.379387 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2b533daa-157b-443e-9548-e096485f39e3 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:28.379831 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2b533daa-157b-443e-9548-e096485f39e3 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:28.437181 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-650facbd-ed53-441f-808f-5544905f33f8 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:28.437795 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-650facbd-ed53-441f-808f-5544905f33f8 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:28.444929 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-650facbd-ed53-441f-808f-5544905f33f8 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:28.445386 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-650facbd-ed53-441f-808f-5544905f33f8 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:28.446155 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-650facbd-ed53-441f-808f-5544905f33f8 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:28.446600 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-650facbd-ed53-441f-808f-5544905f33f8 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:28.513925 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2b533daa-157b-443e-9548-e096485f39e3 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:28.522107 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2b533daa-157b-443e-9548-e096485f39e3 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.155206 May 28 17:28:28.522684 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 201/408] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:28 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:28.573483 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-650facbd-ed53-441f-808f-5544905f33f8 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:28.581378 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-650facbd-ed53-441f-808f-5544905f33f8 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1314 microversion: 2.1 time: 0.148054 May 28 17:28:28.581933 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 208/409] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:28 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:29.154790 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6e4e16c2-69e3-47c2-831c-097657b6d6e0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:29.155327 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6e4e16c2-69e3-47c2-831c-097657b6d6e0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:29.157196 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=82 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:28:29.162443 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6e4e16c2-69e3-47c2-831c-097657b6d6e0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:29.162888 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6e4e16c2-69e3-47c2-831c-097657b6d6e0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:29.163677 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6e4e16c2-69e3-47c2-831c-097657b6d6e0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:29.164118 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6e4e16c2-69e3-47c2-831c-097657b6d6e0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:29.289245 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-6e4e16c2-69e3-47c2-831c-097657b6d6e0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:29.296542 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6e4e16c2-69e3-47c2-831c-097657b6d6e0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.145669 May 28 17:28:29.297103 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 202/410] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:29 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:29.538988 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-928dc78f-59f7-43a7-9327-3a4a007d0785 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:29.539639 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-928dc78f-59f7-43a7-9327-3a4a007d0785 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:29.546825 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-928dc78f-59f7-43a7-9327-3a4a007d0785 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:29.547276 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-928dc78f-59f7-43a7-9327-3a4a007d0785 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:29.548685 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-928dc78f-59f7-43a7-9327-3a4a007d0785 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:29.549123 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-928dc78f-59f7-43a7-9327-3a4a007d0785 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:29.598586 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-beb9cbec-69b5-4330-99be-a680809175a8 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:29.599226 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-beb9cbec-69b5-4330-99be-a680809175a8 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:29.605585 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-beb9cbec-69b5-4330-99be-a680809175a8 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:29.606035 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-beb9cbec-69b5-4330-99be-a680809175a8 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:29.606800 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-beb9cbec-69b5-4330-99be-a680809175a8 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:29.607235 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-beb9cbec-69b5-4330-99be-a680809175a8 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:29.677030 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-928dc78f-59f7-43a7-9327-3a4a007d0785 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:29.684807 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-928dc78f-59f7-43a7-9327-3a4a007d0785 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.149743 May 28 17:28:29.685385 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 209/411] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:29 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:29.947068 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-beb9cbec-69b5-4330-99be-a680809175a8 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:29.955145 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-beb9cbec-69b5-4330-99be-a680809175a8 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1314 microversion: 2.1 time: 0.361071 May 28 17:28:29.955726 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 203/412] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:29 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:30.314588 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d39bd842-c678-496a-b659-43283cf6bdc4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:30.315245 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d39bd842-c678-496a-b659-43283cf6bdc4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:30.321236 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d39bd842-c678-496a-b659-43283cf6bdc4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:30.321678 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d39bd842-c678-496a-b659-43283cf6bdc4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:30.322427 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d39bd842-c678-496a-b659-43283cf6bdc4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:30.322854 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d39bd842-c678-496a-b659-43283cf6bdc4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:30.453102 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d39bd842-c678-496a-b659-43283cf6bdc4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:30.460707 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d39bd842-c678-496a-b659-43283cf6bdc4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.150674 May 28 17:28:30.461279 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 210/413] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:30 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:30.701703 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1c051f85-2814-4494-9744-3a2c1eac7ff5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:30.702417 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1c051f85-2814-4494-9744-3a2c1eac7ff5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:30.714505 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1c051f85-2814-4494-9744-3a2c1eac7ff5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:30.714505 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1c051f85-2814-4494-9744-3a2c1eac7ff5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:30.714505 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1c051f85-2814-4494-9744-3a2c1eac7ff5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:30.714505 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1c051f85-2814-4494-9744-3a2c1eac7ff5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:30.838230 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1c051f85-2814-4494-9744-3a2c1eac7ff5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:30.846145 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1c051f85-2814-4494-9744-3a2c1eac7ff5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.148865 May 28 17:28:30.846709 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 204/414] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:30 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:30.973348 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-564f90c8-50c0-452e-a06f-90e6c14d360c tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:30.973964 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-564f90c8-50c0-452e-a06f-90e6c14d360c tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:30.980340 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-564f90c8-50c0-452e-a06f-90e6c14d360c tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:30.980811 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-564f90c8-50c0-452e-a06f-90e6c14d360c tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:30.981563 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-564f90c8-50c0-452e-a06f-90e6c14d360c tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:30.982021 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-564f90c8-50c0-452e-a06f-90e6c14d360c tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:31.114717 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-564f90c8-50c0-452e-a06f-90e6c14d360c tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:31.122110 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-564f90c8-50c0-452e-a06f-90e6c14d360c tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1314 microversion: 2.1 time: 0.154183 May 28 17:28:31.122666 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 211/415] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:30 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:31.477846 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6f0267d6-d18a-4292-9f75-e548e530dd6a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:31.478495 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6f0267d6-d18a-4292-9f75-e548e530dd6a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:31.484945 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6f0267d6-d18a-4292-9f75-e548e530dd6a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:31.485394 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6f0267d6-d18a-4292-9f75-e548e530dd6a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:31.486209 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6f0267d6-d18a-4292-9f75-e548e530dd6a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:31.486911 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6f0267d6-d18a-4292-9f75-e548e530dd6a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:31.614247 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-6f0267d6-d18a-4292-9f75-e548e530dd6a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:31.621606 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6f0267d6-d18a-4292-9f75-e548e530dd6a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.147623 May 28 17:28:31.622160 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 205/416] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:31 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:31.863757 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-66851f47-134b-4cce-987f-86c839efd00e tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:31.864288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-66851f47-134b-4cce-987f-86c839efd00e tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:31.870257 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-66851f47-134b-4cce-987f-86c839efd00e tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:31.870696 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-66851f47-134b-4cce-987f-86c839efd00e tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:31.871471 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-66851f47-134b-4cce-987f-86c839efd00e tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:31.871901 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-66851f47-134b-4cce-987f-86c839efd00e tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:32.002695 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-66851f47-134b-4cce-987f-86c839efd00e tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:32.010174 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-66851f47-134b-4cce-987f-86c839efd00e tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.151288 May 28 17:28:32.010735 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 212/417] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:31 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:32.139949 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d5fb8a6e-8300-4f1c-b68b-26e9a6669b1c tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:32.140591 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d5fb8a6e-8300-4f1c-b68b-26e9a6669b1c tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:32.147594 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d5fb8a6e-8300-4f1c-b68b-26e9a6669b1c tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:32.148188 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d5fb8a6e-8300-4f1c-b68b-26e9a6669b1c tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:32.149020 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d5fb8a6e-8300-4f1c-b68b-26e9a6669b1c tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:32.149523 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d5fb8a6e-8300-4f1c-b68b-26e9a6669b1c tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:32.278434 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d5fb8a6e-8300-4f1c-b68b-26e9a6669b1c tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:32.286509 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d5fb8a6e-8300-4f1c-b68b-26e9a6669b1c tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1314 microversion: 2.1 time: 0.150589 May 28 17:28:32.287080 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 206/418] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:32 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:32.639188 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-55748403-e068-4666-9fc3-0fb8ebc6e5d6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:32.639865 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-55748403-e068-4666-9fc3-0fb8ebc6e5d6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:32.646831 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-55748403-e068-4666-9fc3-0fb8ebc6e5d6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:32.647281 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-55748403-e068-4666-9fc3-0fb8ebc6e5d6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:32.648070 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-55748403-e068-4666-9fc3-0fb8ebc6e5d6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:32.648526 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-55748403-e068-4666-9fc3-0fb8ebc6e5d6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:32.779459 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-55748403-e068-4666-9fc3-0fb8ebc6e5d6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:32.788028 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-55748403-e068-4666-9fc3-0fb8ebc6e5d6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1501 microversion: 2.1 time: 0.152743 May 28 17:28:32.788594 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 213/419] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:32 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:32.805399 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-fd589e4d-0d06-4469-af96-b6c638a62092 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a2a25cb-8b0b-4919-8bf1-1d2229b17ea9"}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:28:32.806542 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-fd589e4d-0d06-4469-af96-b6c638a62092 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:32.813358 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fd589e4d-0d06-4469-af96-b6c638a62092 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:32.817584 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fd589e4d-0d06-4469-af96-b6c638a62092 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:32.817584 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fd589e4d-0d06-4469-af96-b6c638a62092 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:32.817584 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fd589e4d-0d06-4469-af96-b6c638a62092 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:32.839423 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-fd589e4d-0d06-4469-af96-b6c638a62092 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] HTTP exception thrown: Cannot 'attach_volume' instance 1c3b0710-2e45-41e0-b02a-a9b95245f62a while it is in vm_state rescued May 28 17:28:32.841547 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-fd589e4d-0d06-4469-af96-b6c638a62092 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Request method failure captured: May 28 17:28:32.841547 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: request: POST /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a/os-volume_attachments HTTP/1.1 May 28 17:28:32.841547 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept: application/json May 28 17:28:32.841547 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity May 28 17:28:32.841547 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Connection: close May 28 17:28:32.841547 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Length: 74 May 28 17:28:32.841547 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Type: application/json May 28 17:28:32.841547 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 May 28 17:28:32.841547 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None May 28 17:28:32.841547 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 May 28 17:28:32.841547 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABiklsVPAofKmWg7pU3upj-M8izgby3MaGFgVfx3qysxJVQ7MR6rPa0rRZjJHfi41WGdE8TyYIJQQX0sUjsJLH8BfsxgRgGUV9qPuOrFObQ92QtyvsoGrvxn8VvrbGoJALWgEDz40ZCH_F7fvXkHWOXkwKXZd7Bop_F5hWOJ0OEwQXIUYI May 28 17:28:32.841547 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Id: None May 28 17:28:32.841547 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Name: None May 28 17:28:32.841547 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed May 28 17:28:32.841547 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True May 28 17:28:32.841547 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default May 28 17:28:32.841547 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default May 28 17:28:32.841547 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Id: 8e92a5dc387f47c99ce98da4d6fd9d92 May 28 17:28:32.841547 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1728494172 May 28 17:28:32.841547 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Role: reader,member May 28 17:28:32.841547 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Roles: reader,member May 28 17:28:32.843128 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8e92a5dc387f47c99ce98da4d6fd9d92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8e92a5dc387f47c99ce98da4d6fd9d92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8e92a5dc387f47c99ce98da4d6fd9d92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8e92a5dc387f47c99ce98da4d6fd9d92", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:28:32.843128 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1728494172 May 28 17:28:32.843128 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 8e92a5dc387f47c99ce98da4d6fd9d92 May 28 17:28:32.843128 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1728494172 May 28 17:28:32.843128 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User: tempest-ServerRescueNegativeTestJSON-1728494172-project May 28 17:28:32.843128 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default May 28 17:28:32.843128 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default May 28 17:28:32.843128 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Id: 927f21ef1ca74ec58f85181728933e82 May 28 17:28:32.843128 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1728494172-project May 28 17:28:32.843128 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: May 28 17:28:32.843128 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: {"volumeAttachment": {"volumeId": "7a2a25cb-8b0b-4919-8bf1-1d2229b17ea9"}} May 28 17:28:32.843128 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: method: > May 28 17:28:32.844017 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: exception: Cannot 'attach_volume' instance 1c3b0710-2e45-41e0-b02a-a9b95245f62a while it is in vm_state rescued May 28 17:28:32.844017 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: action_args: {'server_id': '1c3b0710-2e45-41e0-b02a-a9b95245f62a', 'body': {'volumeAttachment': {'volumeId': '7a2a25cb-8b0b-4919-8bf1-1d2229b17ea9'}}} May 28 17:28:32.844017 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:28:32.844017 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:28:32.844017 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 28 17:28:32.844017 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 28 17:28:32.844017 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 17:28:32.844017 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 17:28:32.844017 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 28 17:28:32.844017 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 17:28:32.844017 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1c3b0710-2e45-41e0-b02a-a9b95245f62a in vm_state rescued. Cannot attach_volume while the instance is in this state. May 28 17:28:32.844017 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:28:32.844017 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:28:32.844017 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:28:32.844017 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:28:32.844017 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:28:32.844017 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:28:32.844017 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:28:32.844017 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:28:32.845501 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:28:32.845501 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:28:32.845501 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 17:28:32.845501 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 17:28:32.845501 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 17:28:32.845501 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 17:28:32.845501 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 17:28:32.845501 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 17:28:32.845501 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 28 17:28:32.845501 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 28 17:28:32.845501 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 17:28:32.845501 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 17:28:32.845501 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1c3b0710-2e45-41e0-b02a-a9b95245f62a while it is in vm_state rescued May 28 17:28:32.845501 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:28:32.845501 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:28:32.845501 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:28:32.845501 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:28:32.845501 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:28:32.845501 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:28:32.847284 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:28:32.847284 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:28:32.847284 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1c3b0710-2e45-41e0-b02a-a9b95245f62a while it is in vm_state rescued May 28 17:28:32.847284 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:28:32.847284 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-fd589e4d-0d06-4469-af96-b6c638a62092 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Returning 409 to user: Cannot 'attach_volume' instance 1c3b0710-2e45-41e0-b02a-a9b95245f62a while it is in vm_state rescued {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:28:32.847284 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-fd589e4d-0d06-4469-af96-b6c638a62092 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "POST /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041519 May 28 17:28:32.847284 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 207/420] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 17:28:32 2022] POST /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 17:28:32.855104 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-35b45de3-02d2-4a3c-8539-af1ca074c301 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:28:32.855685 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-35b45de3-02d2-4a3c-8539-af1ca074c301 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:32.862691 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-35b45de3-02d2-4a3c-8539-af1ca074c301 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:32.863131 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-35b45de3-02d2-4a3c-8539-af1ca074c301 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:32.863911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-35b45de3-02d2-4a3c-8539-af1ca074c301 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:32.864342 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-35b45de3-02d2-4a3c-8539-af1ca074c301 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:32.929085 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-35b45de3-02d2-4a3c-8539-af1ca074c301 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "POST /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a/action" status: 202 len: 0 microversion: 2.1 time: 0.080086 May 28 17:28:32.929686 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 214/421] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 17:28:32 2022] POST /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 17:28:32.937665 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0ec5387c-3259-441c-9360-bd1820edb8f2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:32.938303 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0ec5387c-3259-441c-9360-bd1820edb8f2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:32.944811 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0ec5387c-3259-441c-9360-bd1820edb8f2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:32.945254 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0ec5387c-3259-441c-9360-bd1820edb8f2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:32.945999 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0ec5387c-3259-441c-9360-bd1820edb8f2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:32.946430 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0ec5387c-3259-441c-9360-bd1820edb8f2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:33.028394 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2420a83b-3033-41ae-ac26-c779c73c40b4 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:33.029285 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2420a83b-3033-41ae-ac26-c779c73c40b4 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:33.035626 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2420a83b-3033-41ae-ac26-c779c73c40b4 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:33.036076 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2420a83b-3033-41ae-ac26-c779c73c40b4 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:33.036840 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2420a83b-3033-41ae-ac26-c779c73c40b4 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:33.037281 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2420a83b-3033-41ae-ac26-c779c73c40b4 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:33.073934 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0ec5387c-3259-441c-9360-bd1820edb8f2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:33.076098 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=100 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:28:33.084472 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0ec5387c-3259-441c-9360-bd1820edb8f2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1509 microversion: 2.1 time: 0.149542 May 28 17:28:33.085937 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 208/422] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:32 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:33.182079 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-2420a83b-3033-41ae-ac26-c779c73c40b4 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:33.191285 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2420a83b-3033-41ae-ac26-c779c73c40b4 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.167572 May 28 17:28:33.191902 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 215/423] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:33 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:33.304135 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c67bc7b5-4d5f-405f-b316-b7660e6ab9b6 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:33.304673 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c67bc7b5-4d5f-405f-b316-b7660e6ab9b6 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:33.311080 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c67bc7b5-4d5f-405f-b316-b7660e6ab9b6 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:33.311579 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c67bc7b5-4d5f-405f-b316-b7660e6ab9b6 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:33.312338 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c67bc7b5-4d5f-405f-b316-b7660e6ab9b6 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:33.312775 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c67bc7b5-4d5f-405f-b316-b7660e6ab9b6 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:33.448330 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c67bc7b5-4d5f-405f-b316-b7660e6ab9b6 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:33.462062 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c67bc7b5-4d5f-405f-b316-b7660e6ab9b6 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1314 microversion: 2.1 time: 0.161371 May 28 17:28:33.462664 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 209/424] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:33 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:34.102925 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-53924357-7955-4535-a6c2-c17cf74e78fb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:34.103583 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-53924357-7955-4535-a6c2-c17cf74e78fb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:34.110075 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-53924357-7955-4535-a6c2-c17cf74e78fb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:34.110552 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-53924357-7955-4535-a6c2-c17cf74e78fb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:34.111326 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-53924357-7955-4535-a6c2-c17cf74e78fb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:34.111790 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-53924357-7955-4535-a6c2-c17cf74e78fb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:34.208769 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-13823f66-4344-427c-a742-e6b42c6ef041 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:34.210815 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-13823f66-4344-427c-a742-e6b42c6ef041 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:34.215982 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-13823f66-4344-427c-a742-e6b42c6ef041 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:34.216440 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-13823f66-4344-427c-a742-e6b42c6ef041 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:34.217208 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-13823f66-4344-427c-a742-e6b42c6ef041 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:34.217649 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-13823f66-4344-427c-a742-e6b42c6ef041 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:34.241669 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-53924357-7955-4535-a6c2-c17cf74e78fb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:34.250088 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-53924357-7955-4535-a6c2-c17cf74e78fb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1509 microversion: 2.1 time: 0.151022 May 28 17:28:34.260086 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 216/425] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:34 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:34.360215 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-13823f66-4344-427c-a742-e6b42c6ef041 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:34.368026 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-13823f66-4344-427c-a742-e6b42c6ef041 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.163717 May 28 17:28:34.368588 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 210/426] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:34 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:34.481365 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-59f30aa3-b0b9-4351-8bd4-cbf8e2b14a61 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:34.482015 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-59f30aa3-b0b9-4351-8bd4-cbf8e2b14a61 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:34.488295 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-59f30aa3-b0b9-4351-8bd4-cbf8e2b14a61 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:34.488751 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-59f30aa3-b0b9-4351-8bd4-cbf8e2b14a61 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:34.489508 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-59f30aa3-b0b9-4351-8bd4-cbf8e2b14a61 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:34.489947 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-59f30aa3-b0b9-4351-8bd4-cbf8e2b14a61 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:34.619885 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-59f30aa3-b0b9-4351-8bd4-cbf8e2b14a61 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:34.629187 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-59f30aa3-b0b9-4351-8bd4-cbf8e2b14a61 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1314 microversion: 2.1 time: 0.151651 May 28 17:28:34.629745 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 217/427] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:34 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:35.267272 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8bcc9497-e438-4258-8f54-0ae8d30bbc44 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:35.268010 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8bcc9497-e438-4258-8f54-0ae8d30bbc44 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:35.274099 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8bcc9497-e438-4258-8f54-0ae8d30bbc44 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:35.274548 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8bcc9497-e438-4258-8f54-0ae8d30bbc44 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:35.275307 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8bcc9497-e438-4258-8f54-0ae8d30bbc44 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:35.275762 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8bcc9497-e438-4258-8f54-0ae8d30bbc44 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:35.347622 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-cd45587b-e9f0-41c6-a023-732783ebaf25 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:35.348203 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-cd45587b-e9f0-41c6-a023-732783ebaf25 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:35.354663 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cd45587b-e9f0-41c6-a023-732783ebaf25 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:35.355109 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cd45587b-e9f0-41c6-a023-732783ebaf25 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:35.355905 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cd45587b-e9f0-41c6-a023-732783ebaf25 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:35.356344 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cd45587b-e9f0-41c6-a023-732783ebaf25 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:35.409917 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8bcc9497-e438-4258-8f54-0ae8d30bbc44 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:35.417367 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8bcc9497-e438-4258-8f54-0ae8d30bbc44 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1509 microversion: 2.1 time: 0.154006 May 28 17:28:35.417933 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 211/428] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:35 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:35.422307 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d75b7c79-0283-4c36-9513-5d9505968cdb tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:35.423164 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d75b7c79-0283-4c36-9513-5d9505968cdb tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:35.429883 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d75b7c79-0283-4c36-9513-5d9505968cdb tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:35.430336 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d75b7c79-0283-4c36-9513-5d9505968cdb tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:35.431103 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d75b7c79-0283-4c36-9513-5d9505968cdb tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:35.431576 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d75b7c79-0283-4c36-9513-5d9505968cdb tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:35.486193 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-cd45587b-e9f0-41c6-a023-732783ebaf25 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lazy-loading 'services' on Instance uuid e99fbe7a-b9c4-4f37-a515-9e598de8b512 {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 17:28:35.558441 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d75b7c79-0283-4c36-9513-5d9505968cdb tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:35.565916 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d75b7c79-0283-4c36-9513-5d9505968cdb tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.147017 May 28 17:28:35.566483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 212/429] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:35 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:35.603848 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-cd45587b-e9f0-41c6-a023-732783ebaf25 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512/os-volume_attachments/8c736832-e1ee-46a8-a85a-7ffacd9c4b7d" status: 202 len: 0 microversion: 2.1 time: 0.260723 May 28 17:28:35.604441 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 218/430] 10.222.0.33 () {58 vars in 1415 bytes} [Sat May 28 17:28:35 2022] DELETE /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512/os-volume_attachments/8c736832-e1ee-46a8-a85a-7ffacd9c4b7d => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 17:28:35.649395 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d28c533e-1f0c-4a5b-84b9-64ef51f460de tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:35.650347 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d28c533e-1f0c-4a5b-84b9-64ef51f460de tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:35.657226 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d28c533e-1f0c-4a5b-84b9-64ef51f460de tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:35.657771 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d28c533e-1f0c-4a5b-84b9-64ef51f460de tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:35.659311 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d28c533e-1f0c-4a5b-84b9-64ef51f460de tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:35.660133 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d28c533e-1f0c-4a5b-84b9-64ef51f460de tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:35.743464 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-11543be7-ad0e-4411-83c6-f03511c129cd req-448d7d84-b388-4cae-aaed-8f79718e48c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c454eafd-57ce-466c-a88f-aa88a272a56a", "name": "network-vif-plugged", "status": "completed", "tag": "f6092e8b-c7e1-4c14-a7b3-8baa64e42a95"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:28:35.753738 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-11543be7-ad0e-4411-83c6-f03511c129cd req-448d7d84-b388-4cae-aaed-8f79718e48c7 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:35.754202 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-11543be7-ad0e-4411-83c6-f03511c129cd req-448d7d84-b388-4cae-aaed-8f79718e48c7 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:35.773032 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-11543be7-ad0e-4411-83c6-f03511c129cd req-448d7d84-b388-4cae-aaed-8f79718e48c7 service nova] Creating event network-vif-plugged:f6092e8b-c7e1-4c14-a7b3-8baa64e42a95 for instance c454eafd-57ce-466c-a88f-aa88a272a56a on hv-cinder-84372 May 28 17:28:35.778607 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-11543be7-ad0e-4411-83c6-f03511c129cd req-448d7d84-b388-4cae-aaed-8f79718e48c7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040017 May 28 17:28:35.779746 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 219/431] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:28:35.822596 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d28c533e-1f0c-4a5b-84b9-64ef51f460de tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:35.830772 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d28c533e-1f0c-4a5b-84b9-64ef51f460de tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1314 microversion: 2.1 time: 0.188061 May 28 17:28:35.831365 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 213/432] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:35 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:36.437183 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2b04b96f-c8b1-4b8c-b80c-df71636ba893 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:36.438536 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2b04b96f-c8b1-4b8c-b80c-df71636ba893 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:36.445714 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2b04b96f-c8b1-4b8c-b80c-df71636ba893 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:36.446610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2b04b96f-c8b1-4b8c-b80c-df71636ba893 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:36.447419 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2b04b96f-c8b1-4b8c-b80c-df71636ba893 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:36.447920 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2b04b96f-c8b1-4b8c-b80c-df71636ba893 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:36.583546 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-828f5d92-df15-4d77-8e24-076f525885a1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:36.584355 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-828f5d92-df15-4d77-8e24-076f525885a1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:36.592093 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-828f5d92-df15-4d77-8e24-076f525885a1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:36.592708 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-828f5d92-df15-4d77-8e24-076f525885a1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:36.593575 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-828f5d92-df15-4d77-8e24-076f525885a1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:36.594107 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-828f5d92-df15-4d77-8e24-076f525885a1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:36.828289 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-828f5d92-df15-4d77-8e24-076f525885a1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:36.837053 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-828f5d92-df15-4d77-8e24-076f525885a1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.258470 May 28 17:28:36.849077 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 214/433] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:36 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:36.854872 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-eac262bd-ad5e-4ca9-aa5f-e19fb084848e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:36.855534 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-eac262bd-ad5e-4ca9-aa5f-e19fb084848e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:36.862705 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-eac262bd-ad5e-4ca9-aa5f-e19fb084848e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:36.863428 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-eac262bd-ad5e-4ca9-aa5f-e19fb084848e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:36.864378 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-eac262bd-ad5e-4ca9-aa5f-e19fb084848e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:36.864970 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-eac262bd-ad5e-4ca9-aa5f-e19fb084848e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:36.908966 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-2b04b96f-c8b1-4b8c-b80c-df71636ba893 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:36.916631 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2b04b96f-c8b1-4b8c-b80c-df71636ba893 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1509 microversion: 2.1 time: 0.484323 May 28 17:28:36.917281 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 220/434] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:36 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1509 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:37.046712 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-eac262bd-ad5e-4ca9-aa5f-e19fb084848e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:37.054690 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-eac262bd-ad5e-4ca9-aa5f-e19fb084848e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1314 microversion: 2.1 time: 0.203972 May 28 17:28:37.055252 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 215/435] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:36 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:37.831956 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8ed362b4-f053-4fa1-8ea1-4286617cf8d5 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:37.832444 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8ed362b4-f053-4fa1-8ea1-4286617cf8d5 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:37.838731 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8ed362b4-f053-4fa1-8ea1-4286617cf8d5 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:37.839173 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8ed362b4-f053-4fa1-8ea1-4286617cf8d5 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:37.839957 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8ed362b4-f053-4fa1-8ea1-4286617cf8d5 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:37.840388 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8ed362b4-f053-4fa1-8ea1-4286617cf8d5 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:37.844632 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:28:37.854501 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c6a4443b-e0a8-43b0-9697-8a58eff4ed68 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:37.855117 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c6a4443b-e0a8-43b0-9697-8a58eff4ed68 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:37.861772 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c6a4443b-e0a8-43b0-9697-8a58eff4ed68 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:37.862233 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c6a4443b-e0a8-43b0-9697-8a58eff4ed68 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:37.863001 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c6a4443b-e0a8-43b0-9697-8a58eff4ed68 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:37.863480 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c6a4443b-e0a8-43b0-9697-8a58eff4ed68 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:37.868129 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8ed362b4-f053-4fa1-8ea1-4286617cf8d5 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Going to try to terminate instance {{(pid=117604) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 17:28:37.945939 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8ed362b4-f053-4fa1-8ea1-4286617cf8d5 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 204 len: 0 microversion: 2.1 time: 0.118057 May 28 17:28:37.946527 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 221/436] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 17:28:37 2022] DELETE /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 17:28:37.951728 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-cb805dd7-0f85-45ef-97dd-91ae4d4267fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:37.952427 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-cb805dd7-0f85-45ef-97dd-91ae4d4267fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:37.958674 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cb805dd7-0f85-45ef-97dd-91ae4d4267fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:37.959130 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cb805dd7-0f85-45ef-97dd-91ae4d4267fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:37.959937 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cb805dd7-0f85-45ef-97dd-91ae4d4267fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:37.960377 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cb805dd7-0f85-45ef-97dd-91ae4d4267fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:38.010299 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c6a4443b-e0a8-43b0-9697-8a58eff4ed68 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:38.020131 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c6a4443b-e0a8-43b0-9697-8a58eff4ed68 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.169397 May 28 17:28:38.020846 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 216/437] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:37 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:38.028612 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b8ccc622-7e16-4f03-80ca-44476a182145 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:38.029223 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-b8ccc622-7e16-4f03-80ca-44476a182145 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:38.036338 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b8ccc622-7e16-4f03-80ca-44476a182145 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:38.036797 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b8ccc622-7e16-4f03-80ca-44476a182145 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:38.037560 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b8ccc622-7e16-4f03-80ca-44476a182145 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:38.037997 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b8ccc622-7e16-4f03-80ca-44476a182145 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:38.160360 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-cb805dd7-0f85-45ef-97dd-91ae4d4267fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:38.167788 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-cb805dd7-0f85-45ef-97dd-91ae4d4267fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1509 microversion: 2.1 time: 0.220122 May 28 17:28:38.168358 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 222/438] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:37 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1509 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:38.173065 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4e1936a4-bf66-4209-99ad-eefedba1d3ad tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:38.173701 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-4e1936a4-bf66-4209-99ad-eefedba1d3ad tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:38.175713 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:28:38.180519 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b8ccc622-7e16-4f03-80ca-44476a182145 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:38.181384 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4e1936a4-bf66-4209-99ad-eefedba1d3ad tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:38.181810 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4e1936a4-bf66-4209-99ad-eefedba1d3ad tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:38.182576 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4e1936a4-bf66-4209-99ad-eefedba1d3ad tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:38.183006 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4e1936a4-bf66-4209-99ad-eefedba1d3ad tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:38.188894 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b8ccc622-7e16-4f03-80ca-44476a182145 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1515 microversion: 2.1 time: 0.165653 May 28 17:28:38.188894 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 217/439] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:38 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:38.313424 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-4e1936a4-bf66-4209-99ad-eefedba1d3ad tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:38.321793 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-4e1936a4-bf66-4209-99ad-eefedba1d3ad tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1314 microversion: 2.1 time: 0.152182 May 28 17:28:38.322378 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 223/440] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:38 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:39.037810 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-83b83d38-8ccd-4baa-9ee0-09b9b4643387 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:39.038345 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-83b83d38-8ccd-4baa-9ee0-09b9b4643387 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:39.044829 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-83b83d38-8ccd-4baa-9ee0-09b9b4643387 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:39.045274 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-83b83d38-8ccd-4baa-9ee0-09b9b4643387 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:39.046032 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-83b83d38-8ccd-4baa-9ee0-09b9b4643387 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:39.046466 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-83b83d38-8ccd-4baa-9ee0-09b9b4643387 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:39.177783 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-83b83d38-8ccd-4baa-9ee0-09b9b4643387 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:39.185531 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-24d421fb-d5f5-45dd-a466-77d2b0c6d1d0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:39.186228 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-24d421fb-d5f5-45dd-a466-77d2b0c6d1d0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:39.187179 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-83b83d38-8ccd-4baa-9ee0-09b9b4643387 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1358 microversion: 2.1 time: 0.153860 May 28 17:28:39.187936 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 218/441] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:39 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:39.193227 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-24d421fb-d5f5-45dd-a466-77d2b0c6d1d0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:39.193745 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-24d421fb-d5f5-45dd-a466-77d2b0c6d1d0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:39.194574 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-24d421fb-d5f5-45dd-a466-77d2b0c6d1d0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:39.195078 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-24d421fb-d5f5-45dd-a466-77d2b0c6d1d0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:39.205426 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2c7e072b-bda1-49c5-99dd-4251742ab13a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:39.206040 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2c7e072b-bda1-49c5-99dd-4251742ab13a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:39.212007 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2c7e072b-bda1-49c5-99dd-4251742ab13a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:39.212463 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2c7e072b-bda1-49c5-99dd-4251742ab13a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:39.213227 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2c7e072b-bda1-49c5-99dd-4251742ab13a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:39.213662 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2c7e072b-bda1-49c5-99dd-4251742ab13a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:39.323386 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-24d421fb-d5f5-45dd-a466-77d2b0c6d1d0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:39.331723 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-24d421fb-d5f5-45dd-a466-77d2b0c6d1d0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1509 microversion: 2.1 time: 0.150293 May 28 17:28:39.332282 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 224/442] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:39 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:39.342965 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2c7e072b-bda1-49c5-99dd-4251742ab13a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:39.346158 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3a7da912-000d-4333-9518-7a37665703a6 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:39.346815 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3a7da912-000d-4333-9518-7a37665703a6 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:39.351210 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2c7e072b-bda1-49c5-99dd-4251742ab13a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1515 microversion: 2.1 time: 0.149645 May 28 17:28:39.351879 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 219/443] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:39 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:39.352837 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3a7da912-000d-4333-9518-7a37665703a6 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:39.353289 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3a7da912-000d-4333-9518-7a37665703a6 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:39.354066 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3a7da912-000d-4333-9518-7a37665703a6 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:39.354506 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3a7da912-000d-4333-9518-7a37665703a6 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:39.487896 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-3a7da912-000d-4333-9518-7a37665703a6 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:39.495633 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3a7da912-000d-4333-9518-7a37665703a6 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1314 microversion: 2.1 time: 0.153617 May 28 17:28:39.496199 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 225/444] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:39 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:39.681444 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-858c702e-6431-498b-9195-517bc76b91c8 req-2159fac7-371e-4bab-a051-c0a3a1e4c165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d039398-7bb2-4301-8a49-b20879664453", "name": "network-vif-plugged", "status": "completed", "tag": "2fca81f6-5f66-480e-ad69-10b15eddf35a"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:28:39.693850 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-858c702e-6431-498b-9195-517bc76b91c8 req-2159fac7-371e-4bab-a051-c0a3a1e4c165 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:39.695145 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-858c702e-6431-498b-9195-517bc76b91c8 req-2159fac7-371e-4bab-a051-c0a3a1e4c165 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:39.711664 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-858c702e-6431-498b-9195-517bc76b91c8 req-2159fac7-371e-4bab-a051-c0a3a1e4c165 service nova] Creating event network-vif-plugged:2fca81f6-5f66-480e-ad69-10b15eddf35a for instance 4d039398-7bb2-4301-8a49-b20879664453 on hv-cinder-84372 May 28 17:28:39.718058 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-858c702e-6431-498b-9195-517bc76b91c8 req-2159fac7-371e-4bab-a051-c0a3a1e4c165 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040648 May 28 17:28:39.719368 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 220/445] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:28:40.203754 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f931eaf2-d322-4215-8bf3-3ba6d5a0c7b2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:40.204362 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f931eaf2-d322-4215-8bf3-3ba6d5a0c7b2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:40.211066 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f931eaf2-d322-4215-8bf3-3ba6d5a0c7b2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:40.211545 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f931eaf2-d322-4215-8bf3-3ba6d5a0c7b2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:40.212294 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f931eaf2-d322-4215-8bf3-3ba6d5a0c7b2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:40.212722 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f931eaf2-d322-4215-8bf3-3ba6d5a0c7b2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:40.340151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f931eaf2-d322-4215-8bf3-3ba6d5a0c7b2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:40.350139 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3c2179f0-b48e-44ab-b5f5-caa9a05d2251 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:40.350842 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3c2179f0-b48e-44ab-b5f5-caa9a05d2251 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:40.357554 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3c2179f0-b48e-44ab-b5f5-caa9a05d2251 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:40.358475 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3c2179f0-b48e-44ab-b5f5-caa9a05d2251 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:40.359073 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f931eaf2-d322-4215-8bf3-3ba6d5a0c7b2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1547 microversion: 2.1 time: 0.159153 May 28 17:28:40.359366 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3c2179f0-b48e-44ab-b5f5-caa9a05d2251 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:40.359690 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 226/446] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:40 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:40.359823 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3c2179f0-b48e-44ab-b5f5-caa9a05d2251 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:40.367883 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3f9ad979-4f01-4079-ad23-691c10d5efa8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:40.368737 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3f9ad979-4f01-4079-ad23-691c10d5efa8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:40.375216 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3f9ad979-4f01-4079-ad23-691c10d5efa8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:40.375690 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3f9ad979-4f01-4079-ad23-691c10d5efa8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:40.376443 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3f9ad979-4f01-4079-ad23-691c10d5efa8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:40.377668 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3f9ad979-4f01-4079-ad23-691c10d5efa8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:40.510295 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3c2179f0-b48e-44ab-b5f5-caa9a05d2251 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:40.512526 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-3f9ad979-4f01-4079-ad23-691c10d5efa8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:40.517879 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3c2179f0-b48e-44ab-b5f5-caa9a05d2251 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1509 microversion: 2.1 time: 0.172803 May 28 17:28:40.518448 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 221/447] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:40 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:40.520104 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3f9ad979-4f01-4079-ad23-691c10d5efa8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1515 microversion: 2.1 time: 0.155957 May 28 17:28:40.520665 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 227/448] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:40 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:40.525114 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b479fae7-eef0-4fdd-8c54-e6e652b8bccb tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:40.525720 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b479fae7-eef0-4fdd-8c54-e6e652b8bccb tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:40.531516 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b479fae7-eef0-4fdd-8c54-e6e652b8bccb tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:40.531713 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6199da9e-9e40-42a4-a7d2-4f3024ae9b56 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:40.531964 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b479fae7-eef0-4fdd-8c54-e6e652b8bccb tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:40.532300 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6199da9e-9e40-42a4-a7d2-4f3024ae9b56 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:40.532719 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b479fae7-eef0-4fdd-8c54-e6e652b8bccb tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:40.533853 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b479fae7-eef0-4fdd-8c54-e6e652b8bccb tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:40.538613 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6199da9e-9e40-42a4-a7d2-4f3024ae9b56 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:40.539060 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6199da9e-9e40-42a4-a7d2-4f3024ae9b56 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:40.539847 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6199da9e-9e40-42a4-a7d2-4f3024ae9b56 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:40.540280 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6199da9e-9e40-42a4-a7d2-4f3024ae9b56 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:40.663957 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b479fae7-eef0-4fdd-8c54-e6e652b8bccb tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:40.670124 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-6199da9e-9e40-42a4-a7d2-4f3024ae9b56 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:40.671429 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b479fae7-eef0-4fdd-8c54-e6e652b8bccb tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1314 microversion: 2.1 time: 0.149765 May 28 17:28:40.672011 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 228/449] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:40 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:40.678522 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6199da9e-9e40-42a4-a7d2-4f3024ae9b56 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1547 microversion: 2.1 time: 0.150454 May 28 17:28:40.679078 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 222/450] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:40 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:40.693560 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-978c76bd-01a1-4ccd-b860-221fbc40c16f tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:40.696995 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-978c76bd-01a1-4ccd-b860-221fbc40c16f tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:40.697755 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-978c76bd-01a1-4ccd-b860-221fbc40c16f tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Searching by: {'deleted': False, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c'} {{(pid=117604) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 17:28:40.704299 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-978c76bd-01a1-4ccd-b860-221fbc40c16f tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:40.704771 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-978c76bd-01a1-4ccd-b860-221fbc40c16f tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:40.705610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-978c76bd-01a1-4ccd-b860-221fbc40c16f tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:40.705989 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-978c76bd-01a1-4ccd-b860-221fbc40c16f tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:40.799424 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.multi_cell_list [None req-978c76bd-01a1-4ccd-b860-221fbc40c16f tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117604) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 17:28:40.899963 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-978c76bd-01a1-4ccd-b860-221fbc40c16f tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.209892 May 28 17:28:40.900542 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 229/451] 10.222.0.33 () {58 vars in 1124 bytes} [Sat May 28 17:28:40 2022] GET /compute/v2.1/servers => generated 342 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:28:40.911262 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-57365bce-c375-465d-ab1b-865faa434a3f tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:40.911901 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-57365bce-c375-465d-ab1b-865faa434a3f tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:40.917852 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-57365bce-c375-465d-ab1b-865faa434a3f tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:40.918297 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-57365bce-c375-465d-ab1b-865faa434a3f tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:40.919048 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-57365bce-c375-465d-ab1b-865faa434a3f tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:40.919510 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-57365bce-c375-465d-ab1b-865faa434a3f tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:41.049096 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-57365bce-c375-465d-ab1b-865faa434a3f tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:41.067009 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-57365bce-c375-465d-ab1b-865faa434a3f tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1547 microversion: 2.1 time: 0.159918 May 28 17:28:41.068311 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 223/452] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:40 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:41.535102 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-488e1018-233f-4dc6-86fa-36bcc0e66a7b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:41.535811 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-488e1018-233f-4dc6-86fa-36bcc0e66a7b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:41.536688 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4bea02cf-fd49-4149-94f1-c3c3e31599af tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:41.537312 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4bea02cf-fd49-4149-94f1-c3c3e31599af tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:41.542768 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-488e1018-233f-4dc6-86fa-36bcc0e66a7b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:41.543931 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4bea02cf-fd49-4149-94f1-c3c3e31599af tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:41.544141 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-488e1018-233f-4dc6-86fa-36bcc0e66a7b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:41.544528 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4bea02cf-fd49-4149-94f1-c3c3e31599af tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:41.545355 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-488e1018-233f-4dc6-86fa-36bcc0e66a7b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:41.545541 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4bea02cf-fd49-4149-94f1-c3c3e31599af tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:41.545627 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-488e1018-233f-4dc6-86fa-36bcc0e66a7b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:41.545774 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4bea02cf-fd49-4149-94f1-c3c3e31599af tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:41.612710 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4bea02cf-fd49-4149-94f1-c3c3e31599af tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:41.625262 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4bea02cf-fd49-4149-94f1-c3c3e31599af tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1473 microversion: 2.1 time: 0.092364 May 28 17:28:41.625916 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 224/453] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:41 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1473 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:41.688616 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6bd45ba3-7cea-4e39-9f76-25a67eefdccf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:41.690057 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6bd45ba3-7cea-4e39-9f76-25a67eefdccf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:41.696219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6bd45ba3-7cea-4e39-9f76-25a67eefdccf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:41.696801 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6bd45ba3-7cea-4e39-9f76-25a67eefdccf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:41.697644 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6bd45ba3-7cea-4e39-9f76-25a67eefdccf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:41.698093 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6bd45ba3-7cea-4e39-9f76-25a67eefdccf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:41.762348 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-488e1018-233f-4dc6-86fa-36bcc0e66a7b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:41.770482 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-488e1018-233f-4dc6-86fa-36bcc0e66a7b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1509 microversion: 2.1 time: 0.239509 May 28 17:28:41.771057 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 230/454] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:41 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1509 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:41.775518 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-f9be5d1d-353a-4722-8c43-e215e328599c req-1b4138e7-2437-44a8-8f38-0313323f8510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e99fbe7a-b9c4-4f37-a515-9e598de8b512", "name": "network-vif-deleted", "tag": "0bfab207-935d-43ec-8b14-0efcb1026c51"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:28:41.784133 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-f9be5d1d-353a-4722-8c43-e215e328599c req-1b4138e7-2437-44a8-8f38-0313323f8510 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:41.784607 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-f9be5d1d-353a-4722-8c43-e215e328599c req-1b4138e7-2437-44a8-8f38-0313323f8510 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:41.795445 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-f9be5d1d-353a-4722-8c43-e215e328599c req-1b4138e7-2437-44a8-8f38-0313323f8510 service nova] Creating event network-vif-deleted:0bfab207-935d-43ec-8b14-0efcb1026c51 for instance e99fbe7a-b9c4-4f37-a515-9e598de8b512 on hv-cinder-84372 May 28 17:28:41.801076 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-f9be5d1d-353a-4722-8c43-e215e328599c req-1b4138e7-2437-44a8-8f38-0313323f8510 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028826 May 28 17:28:41.801767 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 231/455] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:28:41.836980 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-6bd45ba3-7cea-4e39-9f76-25a67eefdccf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:41.844358 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6bd45ba3-7cea-4e39-9f76-25a67eefdccf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1314 microversion: 2.1 time: 0.159652 May 28 17:28:41.844925 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 225/456] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:41 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:42.644407 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-90f3ddce-4bcc-48fc-a2c6-9186d6ec76f7 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:42.645101 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-90f3ddce-4bcc-48fc-a2c6-9186d6ec76f7 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:42.648890 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-671ff87d-09f1-418d-886c-1ffdce60cf21 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d533c948-6a66-4301-8577-0535edfaa959"}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:28:42.650045 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-671ff87d-09f1-418d-886c-1ffdce60cf21 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:42.651594 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-90f3ddce-4bcc-48fc-a2c6-9186d6ec76f7 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:42.652053 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-90f3ddce-4bcc-48fc-a2c6-9186d6ec76f7 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:42.652824 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-90f3ddce-4bcc-48fc-a2c6-9186d6ec76f7 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:42.653264 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-90f3ddce-4bcc-48fc-a2c6-9186d6ec76f7 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:42.656669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-671ff87d-09f1-418d-886c-1ffdce60cf21 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:42.657122 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-671ff87d-09f1-418d-886c-1ffdce60cf21 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:42.657890 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-671ff87d-09f1-418d-886c-1ffdce60cf21 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:42.658968 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-671ff87d-09f1-418d-886c-1ffdce60cf21 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:42.661502 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=100 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:28:42.716771 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-90f3ddce-4bcc-48fc-a2c6-9186d6ec76f7 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:42.724815 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-90f3ddce-4bcc-48fc-a2c6-9186d6ec76f7 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1473 microversion: 2.1 time: 0.085547 May 28 17:28:42.725389 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 232/457] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:42 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1473 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:42.788186 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-86112ac7-a01e-4fd5-a7db-e0a2a6fad179 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:42.788796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-86112ac7-a01e-4fd5-a7db-e0a2a6fad179 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:42.794823 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-86112ac7-a01e-4fd5-a7db-e0a2a6fad179 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:42.795279 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-86112ac7-a01e-4fd5-a7db-e0a2a6fad179 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:42.796059 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-86112ac7-a01e-4fd5-a7db-e0a2a6fad179 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:42.796494 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-86112ac7-a01e-4fd5-a7db-e0a2a6fad179 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:42.924862 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-86112ac7-a01e-4fd5-a7db-e0a2a6fad179 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:42.932187 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-86112ac7-a01e-4fd5-a7db-e0a2a6fad179 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1509 microversion: 2.1 time: 0.147835 May 28 17:28:42.932750 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 233/458] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:42 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:42.937024 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3ec99867-d2b3-4ade-9dc1-0628d6086566 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:42.937626 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3ec99867-d2b3-4ade-9dc1-0628d6086566 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:42.943864 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3ec99867-d2b3-4ade-9dc1-0628d6086566 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:42.944249 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3ec99867-d2b3-4ade-9dc1-0628d6086566 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:42.945004 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3ec99867-d2b3-4ade-9dc1-0628d6086566 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:42.945440 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3ec99867-d2b3-4ade-9dc1-0628d6086566 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:43.070325 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-3ec99867-d2b3-4ade-9dc1-0628d6086566 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:43.077539 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3ec99867-d2b3-4ade-9dc1-0628d6086566 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1314 microversion: 2.1 time: 0.143869 May 28 17:28:43.078106 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 234/459] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:42 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:43.742084 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ae67c43d-b143-4a50-b01b-f33bfa442d6e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:43.742714 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ae67c43d-b143-4a50-b01b-f33bfa442d6e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:43.749541 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ae67c43d-b143-4a50-b01b-f33bfa442d6e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:43.749992 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ae67c43d-b143-4a50-b01b-f33bfa442d6e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:43.750752 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ae67c43d-b143-4a50-b01b-f33bfa442d6e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:43.751194 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ae67c43d-b143-4a50-b01b-f33bfa442d6e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:43.814929 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ae67c43d-b143-4a50-b01b-f33bfa442d6e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:43.822761 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ae67c43d-b143-4a50-b01b-f33bfa442d6e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1304 microversion: 2.1 time: 0.084718 May 28 17:28:43.823321 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 235/460] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:43 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1304 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:43.949263 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0d57d850-482c-4d49-8aa7-2c20bdfd601d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:43.949876 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0d57d850-482c-4d49-8aa7-2c20bdfd601d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:43.956513 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0d57d850-482c-4d49-8aa7-2c20bdfd601d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:43.956965 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0d57d850-482c-4d49-8aa7-2c20bdfd601d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:43.957723 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0d57d850-482c-4d49-8aa7-2c20bdfd601d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:43.958160 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0d57d850-482c-4d49-8aa7-2c20bdfd601d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:43.973753 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:28:44.098319 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0d57d850-482c-4d49-8aa7-2c20bdfd601d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:44.106176 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0d57d850-482c-4d49-8aa7-2c20bdfd601d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1509 microversion: 2.1 time: 0.160513 May 28 17:28:44.106738 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 236/461] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:43 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:44.111068 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-dbd23a77-1b4a-47ae-b59e-9427d3a9ab98 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:44.111789 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-dbd23a77-1b4a-47ae-b59e-9427d3a9ab98 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:44.117768 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dbd23a77-1b4a-47ae-b59e-9427d3a9ab98 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:44.118248 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dbd23a77-1b4a-47ae-b59e-9427d3a9ab98 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:44.119016 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dbd23a77-1b4a-47ae-b59e-9427d3a9ab98 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:44.119497 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dbd23a77-1b4a-47ae-b59e-9427d3a9ab98 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:44.249072 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-dbd23a77-1b4a-47ae-b59e-9427d3a9ab98 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:44.257229 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-dbd23a77-1b4a-47ae-b59e-9427d3a9ab98 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1314 microversion: 2.1 time: 0.149549 May 28 17:28:44.257945 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 237/462] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:44 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:44.840928 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-279e0968-1fdc-45df-8af9-6faaf9334c75 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:44.841568 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-279e0968-1fdc-45df-8af9-6faaf9334c75 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:44.848781 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-279e0968-1fdc-45df-8af9-6faaf9334c75 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:44.849222 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-279e0968-1fdc-45df-8af9-6faaf9334c75 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:44.849972 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-279e0968-1fdc-45df-8af9-6faaf9334c75 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:44.850401 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-279e0968-1fdc-45df-8af9-6faaf9334c75 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:44.919503 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-279e0968-1fdc-45df-8af9-6faaf9334c75 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:44.927912 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-279e0968-1fdc-45df-8af9-6faaf9334c75 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1304 microversion: 2.1 time: 0.091328 May 28 17:28:44.928477 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 238/463] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:44 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:45.124315 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8e81440d-b822-4cf7-8455-7343937d2ee8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:45.124897 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8e81440d-b822-4cf7-8455-7343937d2ee8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:45.131041 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8e81440d-b822-4cf7-8455-7343937d2ee8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:45.131579 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8e81440d-b822-4cf7-8455-7343937d2ee8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:45.132355 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8e81440d-b822-4cf7-8455-7343937d2ee8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:45.132831 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8e81440d-b822-4cf7-8455-7343937d2ee8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:45.262806 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8e81440d-b822-4cf7-8455-7343937d2ee8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:45.271305 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8e81440d-b822-4cf7-8455-7343937d2ee8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1515 microversion: 2.1 time: 0.151644 May 28 17:28:45.271892 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 239/464] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:45 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:45.276279 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6bae52e6-22a3-4030-ad8a-262d22d0a2bf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:45.276883 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6bae52e6-22a3-4030-ad8a-262d22d0a2bf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:45.282531 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6bae52e6-22a3-4030-ad8a-262d22d0a2bf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:45.284508 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6bae52e6-22a3-4030-ad8a-262d22d0a2bf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:45.284649 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6bae52e6-22a3-4030-ad8a-262d22d0a2bf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:45.285047 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6bae52e6-22a3-4030-ad8a-262d22d0a2bf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:45.436606 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6bae52e6-22a3-4030-ad8a-262d22d0a2bf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:45.445259 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6bae52e6-22a3-4030-ad8a-262d22d0a2bf tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1498 microversion: 2.1 time: 0.172356 May 28 17:28:45.445841 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 240/465] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:45 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1498 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:45.530987 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-671ff87d-09f1-418d-886c-1ffdce60cf21 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "POST /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.885740 May 28 17:28:45.534436 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 226/466] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 17:28:42 2022] POST /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a/os-volume_attachments => generated 194 bytes in 2890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:28:45.944699 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-fb0fa547-2af4-4032-826c-3ba5c18a84df tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:45.945332 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-fb0fa547-2af4-4032-826c-3ba5c18a84df tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:45.951547 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fb0fa547-2af4-4032-826c-3ba5c18a84df tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:45.951987 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fb0fa547-2af4-4032-826c-3ba5c18a84df tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:45.952739 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fb0fa547-2af4-4032-826c-3ba5c18a84df tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:45.953169 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fb0fa547-2af4-4032-826c-3ba5c18a84df tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:45.986155 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fb0fa547-2af4-4032-826c-3ba5c18a84df tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:45.986905 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fb0fa547-2af4-4032-826c-3ba5c18a84df tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:45.987327 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-fb0fa547-2af4-4032-826c-3ba5c18a84df tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lazy-loading 'fault' on Instance uuid e99fbe7a-b9c4-4f37-a515-9e598de8b512 {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 17:28:46.044474 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-fb0fa547-2af4-4032-826c-3ba5c18a84df tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:46.054436 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-fb0fa547-2af4-4032-826c-3ba5c18a84df tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 200 len: 1309 microversion: 2.1 time: 0.113597 May 28 17:28:46.055241 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 241/467] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:45 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 1309 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:46.800621 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-41cf45a4-14b5-45d5-a722-81948b957bd8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Action: 'create', calling method: .version_select at 0x7f9efc2ea430>, body: {"keypair": {"name": "tempest-keypair-1143580303", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKn6pdh9utjb5HHln1pFTv4IDgFjawaWM16Q0W7ZFPSUIqGP9ZC6MgfCOXG9+Kdi2sD77ocWiifCKSMp4nIPaEwZUa0vpzZaDRGE2felzwqxaXeIEzjmm8GwOcYPgkRc2g=="}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:28:46.815877 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-41cf45a4-14b5-45d5-a722-81948b957bd8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Getting quotas for project 8e92a5dc387f47c99ce98da4d6fd9d92. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:28:46.821146 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-41cf45a4-14b5-45d5-a722-81948b957bd8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Getting quotas for user 927f21ef1ca74ec58f85181728933e82 and project 8e92a5dc387f47c99ce98da4d6fd9d92. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:28:46.859656 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-41cf45a4-14b5-45d5-a722-81948b957bd8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064278 May 28 17:28:46.860741 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 227/468] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 17:28:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:28:46.903057 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-798b7a92-07b0-40ec-a330-78f83ebd21e4 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:46.903949 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-798b7a92-07b0-40ec-a330-78f83ebd21e4 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:46.912356 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-798b7a92-07b0-40ec-a330-78f83ebd21e4 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:46.912559 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-798b7a92-07b0-40ec-a330-78f83ebd21e4 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:46.913411 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-798b7a92-07b0-40ec-a330-78f83ebd21e4 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:46.914022 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-798b7a92-07b0-40ec-a330-78f83ebd21e4 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:46.942792 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-798b7a92-07b0-40ec-a330-78f83ebd21e4 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Going to try to terminate instance {{(pid=117604) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 17:28:47.039794 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-798b7a92-07b0-40ec-a330-78f83ebd21e4 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 204 len: 0 microversion: 2.1 time: 0.139363 May 28 17:28:47.042029 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 242/469] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 17:28:46 2022] DELETE /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 17:28:47.050708 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-86e872ba-c04a-46ee-aacd-b3c7388cd540 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:47.051537 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-86e872ba-c04a-46ee-aacd-b3c7388cd540 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:47.059443 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-86e872ba-c04a-46ee-aacd-b3c7388cd540 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:47.060182 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-86e872ba-c04a-46ee-aacd-b3c7388cd540 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:47.060931 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-86e872ba-c04a-46ee-aacd-b3c7388cd540 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:47.061368 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-86e872ba-c04a-46ee-aacd-b3c7388cd540 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:47.075231 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d3bb2b39-8d78-4584-99c8-ac39f64d4a72 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:47.076062 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d3bb2b39-8d78-4584-99c8-ac39f64d4a72 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: e99fbe7a-b9c4-4f37-a515-9e598de8b512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:47.083968 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d3bb2b39-8d78-4584-99c8-ac39f64d4a72 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:47.084521 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d3bb2b39-8d78-4584-99c8-ac39f64d4a72 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:47.085534 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d3bb2b39-8d78-4584-99c8-ac39f64d4a72 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:47.086046 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d3bb2b39-8d78-4584-99c8-ac39f64d4a72 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:47.102090 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-d3bb2b39-8d78-4584-99c8-ac39f64d4a72 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] HTTP exception thrown: Instance e99fbe7a-b9c4-4f37-a515-9e598de8b512 could not be found. May 28 17:28:47.104428 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d3bb2b39-8d78-4584-99c8-ac39f64d4a72 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Request method failure captured: May 28 17:28:47.104428 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 HTTP/1.1 May 28 17:28:47.104428 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:28:47.104428 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:28:47.104428 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:28:47.104428 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 0 May 28 17:28:47.104428 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:28:47.104428 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:28:47.104428 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:28:47.104428 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:28:47.104428 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABiklstF3aOQRUbESyZry29fqSyyeE2N_R22Olnu9tAnyH-IumBfYLMvgbIDTq8Cb93CTaJ6ftKhXckT9qBJBTPZ77gK0Z3gEtGDj5iTB1eJBzZjYuQcrHOP4GKWQKfeLLqVaAIa0ut9MC8Y6erz9ebnkF5jKCig8JumlEt3h_lN-haBtA May 28 17:28:47.104428 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:28:47.104428 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:28:47.104428 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:28:47.104428 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:28:47.104428 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:28:47.104428 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:28:47.104428 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: dd6efc6e9dad4ab1b9c40ab78d5a360d May 28 17:28:47.104428 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-VolumesSnapshotTestJSON-491387215 May 28 17:28:47.104428 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:28:47.104428 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:28:47.106187 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd6efc6e9dad4ab1b9c40ab78d5a360d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd6efc6e9dad4ab1b9c40ab78d5a360d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dd6efc6e9dad4ab1b9c40ab78d5a360d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dd6efc6e9dad4ab1b9c40ab78d5a360d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:28:47.106187 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-VolumesSnapshotTestJSON-491387215 May 28 17:28:47.106187 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: dd6efc6e9dad4ab1b9c40ab78d5a360d May 28 17:28:47.106187 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-491387215 May 28 17:28:47.106187 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-VolumesSnapshotTestJSON-491387215-project May 28 17:28:47.106187 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:28:47.106187 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:28:47.106187 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: b6a6d8ab7cc04e14b8f148412974e995 May 28 17:28:47.106187 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-VolumesSnapshotTestJSON-491387215-project May 28 17:28:47.106187 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: > May 28 17:28:47.106187 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Instance e99fbe7a-b9c4-4f37-a515-9e598de8b512 could not be found. May 28 17:28:47.106187 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'id': 'e99fbe7a-b9c4-4f37-a515-9e598de8b512'} May 28 17:28:47.107092 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:28:47.107092 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:28:47.107092 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:28:47.107092 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:28:47.107092 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:28:47.107092 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:28:47.107092 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:28:47.107092 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:28:47.107092 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:28:47.107092 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:28:47.107092 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e99fbe7a-b9c4-4f37-a515-9e598de8b512 could not be found. May 28 17:28:47.107092 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:28:47.107092 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:28:47.107092 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:28:47.107092 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:28:47.107092 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:28:47.107092 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:28:47.107092 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:28:47.107092 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:28:47.107092 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:28:47.108776 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:28:47.108776 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:28:47.108776 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:28:47.108776 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:28:47.108776 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:28:47.108776 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:28:47.108776 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:28:47.108776 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e99fbe7a-b9c4-4f37-a515-9e598de8b512 could not be found. May 28 17:28:47.108776 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:28:47.108776 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:28:47.108776 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:28:47.108776 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:28:47.108776 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:28:47.108776 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:28:47.108776 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:28:47.108776 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:28:47.108776 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e99fbe7a-b9c4-4f37-a515-9e598de8b512 could not be found. May 28 17:28:47.108776 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:28:47.110117 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d3bb2b39-8d78-4584-99c8-ac39f64d4a72 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Returning 404 to user: Instance e99fbe7a-b9c4-4f37-a515-9e598de8b512 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:28:47.110117 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d3bb2b39-8d78-4584-99c8-ac39f64d4a72 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512" status: 404 len: 111 microversion: 2.1 time: 0.035528 May 28 17:28:47.110117 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 243/470] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:47 2022] GET /compute/v2.1/servers/e99fbe7a-b9c4-4f37-a515-9e598de8b512 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 17:28:47.274724 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-86e872ba-c04a-46ee-aacd-b3c7388cd540 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:47.284191 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-86e872ba-c04a-46ee-aacd-b3c7388cd540 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1504 microversion: 2.1 time: 0.237956 May 28 17:28:47.285470 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 228/471] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:47 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1504 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:48.303990 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b5111418-9f16-4116-89a8-ac20a9635c41 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:48.304613 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b5111418-9f16-4116-89a8-ac20a9635c41 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:48.311765 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b5111418-9f16-4116-89a8-ac20a9635c41 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:48.312437 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b5111418-9f16-4116-89a8-ac20a9635c41 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:48.313297 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b5111418-9f16-4116-89a8-ac20a9635c41 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:48.313744 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b5111418-9f16-4116-89a8-ac20a9635c41 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:48.350791 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8b52a059-daa2-4f9b-a63c-882e684eed5d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-937252974", "imageRef": "b2aab55c-a793-472a-bc32-81af689ad609", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77a1ea92-c07d-41a7-8668-7c3c660591aa"}], "security_groups": [{"name": "tempest-securitygroup--509236682"}], "key_name": "tempest-keypair-1143580303", "user_data": "}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:28:48.456170 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b5111418-9f16-4116-89a8-ac20a9635c41 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:48.462594 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.network.neutron [None req-8b52a059-daa2-4f9b-a63c-882e684eed5d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] validate_networks() for [('77a1ea92-c07d-41a7-8668-7c3c660591aa', None, None, None, None, None)] {{(pid=117605) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 17:28:48.464728 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b5111418-9f16-4116-89a8-ac20a9635c41 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1504 microversion: 2.1 time: 0.165959 May 28 17:28:48.465693 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 244/472] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:48 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:48.843411 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-8b52a059-daa2-4f9b-a63c-882e684eed5d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Flavor limits 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 17:28:48.843838 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-8b52a059-daa2-4f9b-a63c-882e684eed5d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Image limits 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 17:28:48.844313 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-8b52a059-daa2-4f9b-a63c-882e684eed5d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Flavor pref 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 17:28:48.844718 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-8b52a059-daa2-4f9b-a63c-882e684eed5d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Image pref 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 17:28:48.845129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-8b52a059-daa2-4f9b-a63c-882e684eed5d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 17:28:48.854298 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8b52a059-daa2-4f9b-a63c-882e684eed5d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:48.854743 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8b52a059-daa2-4f9b-a63c-882e684eed5d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:48.855575 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8b52a059-daa2-4f9b-a63c-882e684eed5d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:48.856013 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8b52a059-daa2-4f9b-a63c-882e684eed5d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:48.872663 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-8b52a059-daa2-4f9b-a63c-882e684eed5d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Getting quotas for project 8e92a5dc387f47c99ce98da4d6fd9d92. Resources: {'instances', 'cores', 'ram'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:28:48.876824 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-8b52a059-daa2-4f9b-a63c-882e684eed5d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Getting quotas for user 927f21ef1ca74ec58f85181728933e82 and project 8e92a5dc387f47c99ce98da4d6fd9d92. Resources: {'instances', 'cores', 'ram'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:28:48.887730 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8b52a059-daa2-4f9b-a63c-882e684eed5d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Going to run 1 instances... {{(pid=117605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 17:28:48.890005 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8b52a059-daa2-4f9b-a63c-882e684eed5d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b2aab55c-a793-472a-bc32-81af689ad609',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 17:28:48.946236 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8b52a059-daa2-4f9b-a63c-882e684eed5d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.599598 May 28 17:28:48.951935 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 229/473] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 17:28:48 2022] POST /compute/v2.1/servers => generated 408 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 17:28:48.957304 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-da955042-7c68-4d6b-904e-1d15b8557e02 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:48.958331 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-da955042-7c68-4d6b-904e-1d15b8557e02 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:49.013638 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-da955042-7c68-4d6b-904e-1d15b8557e02 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:49.022478 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-da955042-7c68-4d6b-904e-1d15b8557e02 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1245 microversion: 2.1 time: 0.069351 May 28 17:28:49.023360 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 245/474] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:48 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1245 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:49.483187 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1f83cde1-00d9-4d78-b3b4-484035df50ea tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:49.483817 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1f83cde1-00d9-4d78-b3b4-484035df50ea tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:49.493762 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1f83cde1-00d9-4d78-b3b4-484035df50ea tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:49.494286 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1f83cde1-00d9-4d78-b3b4-484035df50ea tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:49.495240 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1f83cde1-00d9-4d78-b3b4-484035df50ea tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:49.495866 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1f83cde1-00d9-4d78-b3b4-484035df50ea tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:49.631199 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1f83cde1-00d9-4d78-b3b4-484035df50ea tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:49.639790 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1f83cde1-00d9-4d78-b3b4-484035df50ea tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1504 microversion: 2.1 time: 0.160634 May 28 17:28:49.640358 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 230/475] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:49 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:50.040682 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-60d7babf-e2ff-4566-913f-ef1640134aa2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:50.041301 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-60d7babf-e2ff-4566-913f-ef1640134aa2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:50.047274 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-60d7babf-e2ff-4566-913f-ef1640134aa2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:50.047754 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-60d7babf-e2ff-4566-913f-ef1640134aa2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:50.049033 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-60d7babf-e2ff-4566-913f-ef1640134aa2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:50.049515 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-60d7babf-e2ff-4566-913f-ef1640134aa2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:50.112939 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-60d7babf-e2ff-4566-913f-ef1640134aa2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:50.120437 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-60d7babf-e2ff-4566-913f-ef1640134aa2 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1249 microversion: 2.1 time: 0.083682 May 28 17:28:50.120951 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 246/476] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:50 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:50.661120 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5adaf431-8034-4458-bf29-2b65f6e807be tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:50.661726 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5adaf431-8034-4458-bf29-2b65f6e807be tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:50.668784 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5adaf431-8034-4458-bf29-2b65f6e807be tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:50.669198 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5adaf431-8034-4458-bf29-2b65f6e807be tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:50.670097 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5adaf431-8034-4458-bf29-2b65f6e807be tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:50.670524 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5adaf431-8034-4458-bf29-2b65f6e807be tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:50.804235 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5adaf431-8034-4458-bf29-2b65f6e807be tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:50.811688 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5adaf431-8034-4458-bf29-2b65f6e807be tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1504 microversion: 2.1 time: 0.156198 May 28 17:28:50.812289 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 231/477] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:50 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:51.138067 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b45c4493-b80f-4345-bc9b-81b9a1516b0e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:51.138682 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b45c4493-b80f-4345-bc9b-81b9a1516b0e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:51.140715 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:28:51.147037 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b45c4493-b80f-4345-bc9b-81b9a1516b0e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:51.147522 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b45c4493-b80f-4345-bc9b-81b9a1516b0e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:51.148288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b45c4493-b80f-4345-bc9b-81b9a1516b0e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:51.148722 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b45c4493-b80f-4345-bc9b-81b9a1516b0e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:51.208154 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b45c4493-b80f-4345-bc9b-81b9a1516b0e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:51.215475 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b45c4493-b80f-4345-bc9b-81b9a1516b0e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1249 microversion: 2.1 time: 0.081232 May 28 17:28:51.216035 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 247/478] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:51 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:51.829128 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d564ad5d-8395-4885-a50b-619170c3c941 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:51.830368 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d564ad5d-8395-4885-a50b-619170c3c941 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:51.836865 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d564ad5d-8395-4885-a50b-619170c3c941 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:51.837318 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d564ad5d-8395-4885-a50b-619170c3c941 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:51.838078 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d564ad5d-8395-4885-a50b-619170c3c941 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:51.838517 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d564ad5d-8395-4885-a50b-619170c3c941 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:51.974189 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d564ad5d-8395-4885-a50b-619170c3c941 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:51.981689 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d564ad5d-8395-4885-a50b-619170c3c941 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1504 microversion: 2.1 time: 0.156537 May 28 17:28:51.982251 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 232/479] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:51 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:52.232877 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a9a3daff-29b1-4718-b292-0cc5429166bd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:52.233406 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a9a3daff-29b1-4718-b292-0cc5429166bd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:52.240707 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a9a3daff-29b1-4718-b292-0cc5429166bd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:52.241152 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a9a3daff-29b1-4718-b292-0cc5429166bd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:52.241913 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a9a3daff-29b1-4718-b292-0cc5429166bd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:52.242346 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a9a3daff-29b1-4718-b292-0cc5429166bd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:52.307738 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a9a3daff-29b1-4718-b292-0cc5429166bd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:52.316761 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a9a3daff-29b1-4718-b292-0cc5429166bd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1305 microversion: 2.1 time: 0.087835 May 28 17:28:52.317350 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 248/480] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:52 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1305 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:52.846779 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-85bf336f-89b5-430b-908a-479279d6c7a1 req-067090cc-7ff3-4222-b5ce-7324b76d0c75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d039398-7bb2-4301-8a49-b20879664453", "name": "network-vif-deleted", "tag": "2fca81f6-5f66-480e-ad69-10b15eddf35a"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:28:52.856126 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-85bf336f-89b5-430b-908a-479279d6c7a1 req-067090cc-7ff3-4222-b5ce-7324b76d0c75 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:52.856665 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-85bf336f-89b5-430b-908a-479279d6c7a1 req-067090cc-7ff3-4222-b5ce-7324b76d0c75 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:52.868323 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-85bf336f-89b5-430b-908a-479279d6c7a1 req-067090cc-7ff3-4222-b5ce-7324b76d0c75 service nova] Creating event network-vif-deleted:2fca81f6-5f66-480e-ad69-10b15eddf35a for instance 4d039398-7bb2-4301-8a49-b20879664453 on hv-cinder-84372 May 28 17:28:52.873375 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-85bf336f-89b5-430b-908a-479279d6c7a1 req-067090cc-7ff3-4222-b5ce-7324b76d0c75 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030633 May 28 17:28:52.874557 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 233/481] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:28:52.998200 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-42a3f4ce-b716-4a0a-a490-8720106ea600 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:52.998951 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-42a3f4ce-b716-4a0a-a490-8720106ea600 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:53.005971 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-42a3f4ce-b716-4a0a-a490-8720106ea600 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:53.006417 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-42a3f4ce-b716-4a0a-a490-8720106ea600 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:53.007176 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-42a3f4ce-b716-4a0a-a490-8720106ea600 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:53.007804 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-42a3f4ce-b716-4a0a-a490-8720106ea600 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:53.039725 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-42a3f4ce-b716-4a0a-a490-8720106ea600 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:53.040171 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-42a3f4ce-b716-4a0a-a490-8720106ea600 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:53.040616 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-42a3f4ce-b716-4a0a-a490-8720106ea600 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lazy-loading 'fault' on Instance uuid 4d039398-7bb2-4301-8a49-b20879664453 {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 17:28:53.083029 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-42a3f4ce-b716-4a0a-a490-8720106ea600 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:53.090586 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-42a3f4ce-b716-4a0a-a490-8720106ea600 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 200 len: 1304 microversion: 2.1 time: 0.096287 May 28 17:28:53.091141 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 249/482] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:52 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:53.335787 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-41b637ae-3377-4d16-83d8-a396a997884e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:53.336494 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-41b637ae-3377-4d16-83d8-a396a997884e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:53.344390 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-41b637ae-3377-4d16-83d8-a396a997884e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:53.344840 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-41b637ae-3377-4d16-83d8-a396a997884e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:53.346116 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-41b637ae-3377-4d16-83d8-a396a997884e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:53.346548 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-41b637ae-3377-4d16-83d8-a396a997884e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:53.539473 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-41b637ae-3377-4d16-83d8-a396a997884e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:53.551194 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-41b637ae-3377-4d16-83d8-a396a997884e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1370 microversion: 2.1 time: 0.220128 May 28 17:28:53.552430 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 234/483] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:53 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1370 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:54.108503 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1c65e357-b97d-4549-a6c7-5136f60cb11f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:54.109092 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1c65e357-b97d-4549-a6c7-5136f60cb11f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 4d039398-7bb2-4301-8a49-b20879664453] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:54.116310 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c65e357-b97d-4549-a6c7-5136f60cb11f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:54.116758 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c65e357-b97d-4549-a6c7-5136f60cb11f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:54.117517 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c65e357-b97d-4549-a6c7-5136f60cb11f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:54.117945 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c65e357-b97d-4549-a6c7-5136f60cb11f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:54.138895 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-1c65e357-b97d-4549-a6c7-5136f60cb11f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] HTTP exception thrown: Instance 4d039398-7bb2-4301-8a49-b20879664453 could not be found. May 28 17:28:54.140637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1c65e357-b97d-4549-a6c7-5136f60cb11f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Request method failure captured: May 28 17:28:54.140637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 HTTP/1.1 May 28 17:28:54.140637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:28:54.140637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:28:54.140637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:28:54.140637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 0 May 28 17:28:54.140637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:28:54.140637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:28:54.140637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:28:54.140637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:28:54.140637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABikluUS_RWrzKqQJ6aEhlbJPnPoxRHLUbYW8e2vNpXzl--Ze9NIU8NkpWhZsAD3wvelK3QvNuf-nUXGmuxoT0eL7jJBm5AKlAJYloqCbE4cXj8l4ZEfo80wwGSxDVuvvf4VnpzhM_2KJPwVF1r376VhGqigdQPPwITdhANkE4hdF2PZ1U May 28 17:28:54.140637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:28:54.140637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:28:54.140637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:28:54.140637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:28:54.140637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:28:54.140637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:28:54.140637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: 9065845ed3d0457c9ab0889760958a32 May 28 17:28:54.140637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-VolumesActionsTest-997537412 May 28 17:28:54.140637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:28:54.140637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:28:54.141891 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9065845ed3d0457c9ab0889760958a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9065845ed3d0457c9ab0889760958a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9065845ed3d0457c9ab0889760958a32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9065845ed3d0457c9ab0889760958a32", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:28:54.141891 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-VolumesActionsTest-997537412 May 28 17:28:54.141891 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 9065845ed3d0457c9ab0889760958a32 May 28 17:28:54.141891 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-VolumesActionsTest-997537412 May 28 17:28:54.141891 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-VolumesActionsTest-997537412-project May 28 17:28:54.141891 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:28:54.141891 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:28:54.141891 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: 14273a09857f431bb7841b321b913c00 May 28 17:28:54.141891 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-VolumesActionsTest-997537412-project May 28 17:28:54.141891 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: > May 28 17:28:54.141891 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Instance 4d039398-7bb2-4301-8a49-b20879664453 could not be found. May 28 17:28:54.141891 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'id': '4d039398-7bb2-4301-8a49-b20879664453'} May 28 17:28:54.143091 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:28:54.143091 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:28:54.143091 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:28:54.143091 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:28:54.143091 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:28:54.143091 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:28:54.143091 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:28:54.143091 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:28:54.143091 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:28:54.143091 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:28:54.143091 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d039398-7bb2-4301-8a49-b20879664453 could not be found. May 28 17:28:54.143091 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:28:54.143091 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:28:54.143091 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:28:54.143091 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:28:54.143091 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:28:54.143091 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:28:54.143091 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:28:54.143091 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:28:54.143091 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:28:54.144288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:28:54.144288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:28:54.144288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:28:54.144288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:28:54.144288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:28:54.144288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:28:54.144288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:28:54.144288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d039398-7bb2-4301-8a49-b20879664453 could not be found. May 28 17:28:54.144288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:28:54.144288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:28:54.144288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:28:54.144288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:28:54.144288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:28:54.144288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:28:54.144288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:28:54.144288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:28:54.144288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d039398-7bb2-4301-8a49-b20879664453 could not be found. May 28 17:28:54.144288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:28:54.146454 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-918eb65c-3364-469d-ac63-e71e3befed1e req-f14d58d0-2c68-4cbf-88bd-46f4f54649a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "435314f8-f9b7-4e9c-94f3-8a84190965b9", "tag": "5ea754ee-2216-4168-ad09-190faba5d36c"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:28:54.146970 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1c65e357-b97d-4549-a6c7-5136f60cb11f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Returning 404 to user: Instance 4d039398-7bb2-4301-8a49-b20879664453 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:28:54.147745 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1c65e357-b97d-4549-a6c7-5136f60cb11f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453" status: 404 len: 111 microversion: 2.1 time: 0.043263 May 28 17:28:54.148379 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 250/484] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:54 2022] GET /compute/v2.1/servers/4d039398-7bb2-4301-8a49-b20879664453 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:28:54.166654 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-918eb65c-3364-469d-ac63-e71e3befed1e req-f14d58d0-2c68-4cbf-88bd-46f4f54649a5 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:54.168626 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-918eb65c-3364-469d-ac63-e71e3befed1e req-f14d58d0-2c68-4cbf-88bd-46f4f54649a5 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:54.191773 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-918eb65c-3364-469d-ac63-e71e3befed1e req-f14d58d0-2c68-4cbf-88bd-46f4f54649a5 service nova] Creating event network-changed:5ea754ee-2216-4168-ad09-190faba5d36c for instance 435314f8-f9b7-4e9c-94f3-8a84190965b9 on hv-cinder-84372 May 28 17:28:54.198188 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-918eb65c-3364-469d-ac63-e71e3befed1e req-f14d58d0-2c68-4cbf-88bd-46f4f54649a5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055200 May 28 17:28:54.199068 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 235/485] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:28:54.284976 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f8102918-b17a-4752-9f41-e88ee33dbb85 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-220315364", "imageRef": "b2aab55c-a793-472a-bc32-81af689ad609", "flavorRef": "452", "networks": [{"uuid": "75e9d121-0dd7-4765-8420-f3e8c1d9b007"}]}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:28:54.339484 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.network.neutron [None req-f8102918-b17a-4752-9f41-e88ee33dbb85 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] validate_networks() for [('75e9d121-0dd7-4765-8420-f3e8c1d9b007', None, None, None, None, None)] {{(pid=117604) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 17:28:54.569707 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8aa7cd5b-93da-49b9-9d3c-df523850d813 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:54.570670 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8aa7cd5b-93da-49b9-9d3c-df523850d813 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:54.578029 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8aa7cd5b-93da-49b9-9d3c-df523850d813 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:54.578408 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8aa7cd5b-93da-49b9-9d3c-df523850d813 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:54.579191 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8aa7cd5b-93da-49b9-9d3c-df523850d813 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:54.580159 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8aa7cd5b-93da-49b9-9d3c-df523850d813 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:54.737182 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-f8102918-b17a-4752-9f41-e88ee33dbb85 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Flavor limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 17:28:54.737746 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-f8102918-b17a-4752-9f41-e88ee33dbb85 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Image limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 17:28:54.738230 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-f8102918-b17a-4752-9f41-e88ee33dbb85 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Flavor pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 17:28:54.738815 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-f8102918-b17a-4752-9f41-e88ee33dbb85 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Image pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 17:28:54.739240 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-f8102918-b17a-4752-9f41-e88ee33dbb85 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 17:28:54.748247 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f8102918-b17a-4752-9f41-e88ee33dbb85 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:54.749044 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f8102918-b17a-4752-9f41-e88ee33dbb85 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:54.749980 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f8102918-b17a-4752-9f41-e88ee33dbb85 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:54.750496 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f8102918-b17a-4752-9f41-e88ee33dbb85 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:54.771446 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-f8102918-b17a-4752-9f41-e88ee33dbb85 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Getting quotas for project 9065845ed3d0457c9ab0889760958a32. Resources: {'instances', 'cores', 'ram'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:28:54.776148 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-f8102918-b17a-4752-9f41-e88ee33dbb85 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Getting quotas for user 14273a09857f431bb7841b321b913c00 and project 9065845ed3d0457c9ab0889760958a32. Resources: {'instances', 'cores', 'ram'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:28:54.788102 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f8102918-b17a-4752-9f41-e88ee33dbb85 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Going to run 1 instances... {{(pid=117604) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 17:28:54.790567 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f8102918-b17a-4752-9f41-e88ee33dbb85 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b2aab55c-a793-472a-bc32-81af689ad609',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 17:28:54.792189 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8aa7cd5b-93da-49b9-9d3c-df523850d813 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:54.800275 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8aa7cd5b-93da-49b9-9d3c-df523850d813 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1370 microversion: 2.1 time: 0.234852 May 28 17:28:54.800842 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 236/486] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:54 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1370 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:54.836375 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f8102918-b17a-4752-9f41-e88ee33dbb85 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555478 May 28 17:28:54.837182 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 251/487] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 17:28:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 17:28:54.846913 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3c1411f0-995c-4cd0-9948-6fa2a9ac78d3 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:54.847558 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3c1411f0-995c-4cd0-9948-6fa2a9ac78d3 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:54.904509 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3c1411f0-995c-4cd0-9948-6fa2a9ac78d3 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:54.911782 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3c1411f0-995c-4cd0-9948-6fa2a9ac78d3 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9" status: 200 len: 1213 microversion: 2.1 time: 0.068773 May 28 17:28:54.912356 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 237/488] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:54 2022] GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:55.817588 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6e9f0f94-291e-4c5c-9a14-c89aaf7ce4e7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:55.818205 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6e9f0f94-291e-4c5c-9a14-c89aaf7ce4e7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:55.824862 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6e9f0f94-291e-4c5c-9a14-c89aaf7ce4e7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:55.825309 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6e9f0f94-291e-4c5c-9a14-c89aaf7ce4e7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:55.826072 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6e9f0f94-291e-4c5c-9a14-c89aaf7ce4e7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:55.826513 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6e9f0f94-291e-4c5c-9a14-c89aaf7ce4e7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:55.929360 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4f9ea77c-7d3f-4720-8243-b1d73d4d7a3e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:55.929976 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4f9ea77c-7d3f-4720-8243-b1d73d4d7a3e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:55.932449 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:28:55.941787 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4f9ea77c-7d3f-4720-8243-b1d73d4d7a3e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:55.942243 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4f9ea77c-7d3f-4720-8243-b1d73d4d7a3e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:55.943011 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4f9ea77c-7d3f-4720-8243-b1d73d4d7a3e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:55.943478 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4f9ea77c-7d3f-4720-8243-b1d73d4d7a3e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:55.953170 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6e9f0f94-291e-4c5c-9a14-c89aaf7ce4e7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:55.960813 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6e9f0f94-291e-4c5c-9a14-c89aaf7ce4e7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1370 microversion: 2.1 time: 0.147777 May 28 17:28:55.961380 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 252/489] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:55 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:56.008448 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4f9ea77c-7d3f-4720-8243-b1d73d4d7a3e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:56.015800 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4f9ea77c-7d3f-4720-8243-b1d73d4d7a3e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9" status: 200 len: 1217 microversion: 2.1 time: 0.090267 May 28 17:28:56.016353 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 238/490] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:55 2022] GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:56.977718 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5a1c1557-3258-4f1b-bd53-59c02d12422f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:56.978363 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5a1c1557-3258-4f1b-bd53-59c02d12422f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:56.984823 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5a1c1557-3258-4f1b-bd53-59c02d12422f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:56.985269 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5a1c1557-3258-4f1b-bd53-59c02d12422f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:56.986062 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5a1c1557-3258-4f1b-bd53-59c02d12422f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:56.986498 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5a1c1557-3258-4f1b-bd53-59c02d12422f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:57.032474 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-788ee9f9-6ddc-417b-b30c-8be427d6f2e3 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:57.033092 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-788ee9f9-6ddc-417b-b30c-8be427d6f2e3 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:57.039579 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-788ee9f9-6ddc-417b-b30c-8be427d6f2e3 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:57.040030 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-788ee9f9-6ddc-417b-b30c-8be427d6f2e3 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:57.040794 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-788ee9f9-6ddc-417b-b30c-8be427d6f2e3 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:57.041231 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-788ee9f9-6ddc-417b-b30c-8be427d6f2e3 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:57.102201 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-788ee9f9-6ddc-417b-b30c-8be427d6f2e3 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:57.109718 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-788ee9f9-6ddc-417b-b30c-8be427d6f2e3 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9" status: 200 len: 1217 microversion: 2.1 time: 0.081014 May 28 17:28:57.110362 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 239/491] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:57 2022] GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:57.123810 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5a1c1557-3258-4f1b-bd53-59c02d12422f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:57.125965 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:28:57.133299 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5a1c1557-3258-4f1b-bd53-59c02d12422f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1370 microversion: 2.1 time: 0.159451 May 28 17:28:57.133851 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 253/492] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:56 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:58.127710 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2e5f6972-8caa-4bef-b6a9-214e0b6e5e4b tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:58.128797 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2e5f6972-8caa-4bef-b6a9-214e0b6e5e4b tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:58.135333 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2e5f6972-8caa-4bef-b6a9-214e0b6e5e4b tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:58.135811 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2e5f6972-8caa-4bef-b6a9-214e0b6e5e4b tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:58.136630 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2e5f6972-8caa-4bef-b6a9-214e0b6e5e4b tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:58.137073 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2e5f6972-8caa-4bef-b6a9-214e0b6e5e4b tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:58.150747 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2f4d69b8-94d9-4072-9850-c5bee42226b0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:58.151359 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2f4d69b8-94d9-4072-9850-c5bee42226b0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:58.161259 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2f4d69b8-94d9-4072-9850-c5bee42226b0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:58.161700 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2f4d69b8-94d9-4072-9850-c5bee42226b0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:58.162470 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2f4d69b8-94d9-4072-9850-c5bee42226b0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:58.162903 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2f4d69b8-94d9-4072-9850-c5bee42226b0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:58.207559 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2e5f6972-8caa-4bef-b6a9-214e0b6e5e4b tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:58.216005 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2e5f6972-8caa-4bef-b6a9-214e0b6e5e4b tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9" status: 200 len: 1209 microversion: 2.1 time: 0.093113 May 28 17:28:58.216809 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 240/493] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:58 2022] GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 => generated 1209 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:58.306878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-2f4d69b8-94d9-4072-9850-c5bee42226b0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:58.314630 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2f4d69b8-94d9-4072-9850-c5bee42226b0 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1370 microversion: 2.1 time: 0.168373 May 28 17:28:58.315197 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 254/494] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:58 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:59.188238 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4454513f-a53f-4b6f-8bf8-5325e0c90cf2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1951595839", "imageRef": "b2aab55c-a793-472a-bc32-81af689ad609", "flavorRef": "452", "networks": [{"uuid": "64d9df32-417a-4110-9ebe-97bfa607c330"}]}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:28:59.194939 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=2 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:28:59.235032 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b2e4f8b6-9561-4f5e-ba9e-82fdaf20159e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:59.235779 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b2e4f8b6-9561-4f5e-ba9e-82fdaf20159e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:59.239745 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.network.neutron [None req-4454513f-a53f-4b6f-8bf8-5325e0c90cf2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] validate_networks() for [('64d9df32-417a-4110-9ebe-97bfa607c330', None, None, None, None, None)] {{(pid=117605) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 17:28:59.243008 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b2e4f8b6-9561-4f5e-ba9e-82fdaf20159e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:59.243489 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b2e4f8b6-9561-4f5e-ba9e-82fdaf20159e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:59.244271 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b2e4f8b6-9561-4f5e-ba9e-82fdaf20159e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:59.244710 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b2e4f8b6-9561-4f5e-ba9e-82fdaf20159e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:59.308004 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b2e4f8b6-9561-4f5e-ba9e-82fdaf20159e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:59.315700 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b2e4f8b6-9561-4f5e-ba9e-82fdaf20159e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9" status: 200 len: 1265 microversion: 2.1 time: 0.084395 May 28 17:28:59.316202 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 255/495] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:59 2022] GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:28:59.332936 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3f5b507c-f5cb-491c-b748-4b554d6b0b6c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:59.333539 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3f5b507c-f5cb-491c-b748-4b554d6b0b6c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:59.339600 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3f5b507c-f5cb-491c-b748-4b554d6b0b6c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:59.340046 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3f5b507c-f5cb-491c-b748-4b554d6b0b6c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:59.340828 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3f5b507c-f5cb-491c-b748-4b554d6b0b6c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:59.341262 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3f5b507c-f5cb-491c-b748-4b554d6b0b6c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:59.480775 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-3f5b507c-f5cb-491c-b748-4b554d6b0b6c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:59.505878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3f5b507c-f5cb-491c-b748-4b554d6b0b6c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1370 microversion: 2.1 time: 0.176719 May 28 17:28:59.506666 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 256/496] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:59 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:28:59.595652 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-4454513f-a53f-4b6f-8bf8-5325e0c90cf2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Flavor limits 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 17:28:59.596077 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-4454513f-a53f-4b6f-8bf8-5325e0c90cf2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Image limits 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 17:28:59.596554 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-4454513f-a53f-4b6f-8bf8-5325e0c90cf2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Flavor pref 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 17:28:59.596992 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-4454513f-a53f-4b6f-8bf8-5325e0c90cf2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Image pref 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 17:28:59.597401 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-4454513f-a53f-4b6f-8bf8-5325e0c90cf2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 17:28:59.606380 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4454513f-a53f-4b6f-8bf8-5325e0c90cf2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:59.606826 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4454513f-a53f-4b6f-8bf8-5325e0c90cf2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:59.607653 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4454513f-a53f-4b6f-8bf8-5325e0c90cf2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:28:59.608084 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4454513f-a53f-4b6f-8bf8-5325e0c90cf2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:28:59.624875 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-4454513f-a53f-4b6f-8bf8-5325e0c90cf2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Getting quotas for project dd6efc6e9dad4ab1b9c40ab78d5a360d. Resources: {'instances', 'cores', 'ram'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:28:59.629579 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-4454513f-a53f-4b6f-8bf8-5325e0c90cf2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Getting quotas for user b6a6d8ab7cc04e14b8f148412974e995 and project dd6efc6e9dad4ab1b9c40ab78d5a360d. Resources: {'instances', 'cores', 'ram'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:28:59.640708 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4454513f-a53f-4b6f-8bf8-5325e0c90cf2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Going to run 1 instances... {{(pid=117605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 17:28:59.643088 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4454513f-a53f-4b6f-8bf8-5325e0c90cf2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: a3819481-ecb7-47a2-86b2-78c6c1c40d61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b2aab55c-a793-472a-bc32-81af689ad609',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 17:28:59.688501 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4454513f-a53f-4b6f-8bf8-5325e0c90cf2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.503982 May 28 17:28:59.689750 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 241/497] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 17:28:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 17:28:59.699743 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1ffa29b8-2a8b-445b-9f54-170c76d1247e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:28:59.700455 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1ffa29b8-2a8b-445b-9f54-170c76d1247e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: a3819481-ecb7-47a2-86b2-78c6c1c40d61] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:28:59.757582 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1ffa29b8-2a8b-445b-9f54-170c76d1247e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:28:59.764822 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1ffa29b8-2a8b-445b-9f54-170c76d1247e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61" status: 200 len: 1219 microversion: 2.1 time: 0.068906 May 28 17:28:59.765388 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 257/498] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:28:59 2022] GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:00.333455 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1a52aeb0-5b8d-40a2-98b0-547c36f818ba tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:00.334067 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1a52aeb0-5b8d-40a2-98b0-547c36f818ba tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:00.341162 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1a52aeb0-5b8d-40a2-98b0-547c36f818ba tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:00.341610 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1a52aeb0-5b8d-40a2-98b0-547c36f818ba tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:00.342359 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1a52aeb0-5b8d-40a2-98b0-547c36f818ba tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:00.342787 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1a52aeb0-5b8d-40a2-98b0-547c36f818ba tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:00.403040 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1a52aeb0-5b8d-40a2-98b0-547c36f818ba tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:00.411393 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1a52aeb0-5b8d-40a2-98b0-547c36f818ba tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9" status: 200 len: 1265 microversion: 2.1 time: 0.082819 May 28 17:29:00.411949 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 242/499] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:00 2022] GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:00.523015 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-bd2cbf6f-43e4-479b-9b02-44870a2c53ee tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:00.523662 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-bd2cbf6f-43e4-479b-9b02-44870a2c53ee tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:00.530216 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bd2cbf6f-43e4-479b-9b02-44870a2c53ee tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:00.530657 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bd2cbf6f-43e4-479b-9b02-44870a2c53ee tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:00.531443 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bd2cbf6f-43e4-479b-9b02-44870a2c53ee tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:00.531872 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bd2cbf6f-43e4-479b-9b02-44870a2c53ee tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:00.662500 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-bd2cbf6f-43e4-479b-9b02-44870a2c53ee tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:00.669928 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-bd2cbf6f-43e4-479b-9b02-44870a2c53ee tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1370 microversion: 2.1 time: 0.150726 May 28 17:29:00.670494 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 258/500] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:00 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:29:00.781630 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6a65b0c1-0dab-4ae5-9535-876463244b60 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:00.782248 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6a65b0c1-0dab-4ae5-9535-876463244b60 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: a3819481-ecb7-47a2-86b2-78c6c1c40d61] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:00.788810 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6a65b0c1-0dab-4ae5-9535-876463244b60 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:00.789261 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6a65b0c1-0dab-4ae5-9535-876463244b60 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:00.790021 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6a65b0c1-0dab-4ae5-9535-876463244b60 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:00.790458 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6a65b0c1-0dab-4ae5-9535-876463244b60 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:00.850965 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-6a65b0c1-0dab-4ae5-9535-876463244b60 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:00.858240 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6a65b0c1-0dab-4ae5-9535-876463244b60 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61" status: 200 len: 1223 microversion: 2.1 time: 0.080451 May 28 17:29:00.858804 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 243/501] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:00 2022] GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:01.428865 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b826ae0c-1958-49b0-86dd-5c659acac832 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:01.429539 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b826ae0c-1958-49b0-86dd-5c659acac832 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:01.431474 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:29:01.437216 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b826ae0c-1958-49b0-86dd-5c659acac832 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:01.437665 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b826ae0c-1958-49b0-86dd-5c659acac832 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:01.438422 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b826ae0c-1958-49b0-86dd-5c659acac832 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:01.438857 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b826ae0c-1958-49b0-86dd-5c659acac832 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:01.503302 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b826ae0c-1958-49b0-86dd-5c659acac832 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:01.510718 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b826ae0c-1958-49b0-86dd-5c659acac832 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9" status: 200 len: 1265 microversion: 2.1 time: 0.086320 May 28 17:29:01.511262 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 259/502] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:01 2022] GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:01.686484 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6e7ec1fb-23c2-436f-8c59-124447fa202a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:01.687117 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6e7ec1fb-23c2-436f-8c59-124447fa202a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:01.693762 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6e7ec1fb-23c2-436f-8c59-124447fa202a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:01.694212 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6e7ec1fb-23c2-436f-8c59-124447fa202a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:01.694979 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6e7ec1fb-23c2-436f-8c59-124447fa202a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:01.695441 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6e7ec1fb-23c2-436f-8c59-124447fa202a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:01.875947 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5fae1a67-6df4-475c-be08-6d3f18e4a08d tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:01.876558 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5fae1a67-6df4-475c-be08-6d3f18e4a08d tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: a3819481-ecb7-47a2-86b2-78c6c1c40d61] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:01.883234 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5fae1a67-6df4-475c-be08-6d3f18e4a08d tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:01.883707 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5fae1a67-6df4-475c-be08-6d3f18e4a08d tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:01.884475 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5fae1a67-6df4-475c-be08-6d3f18e4a08d tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:01.884913 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5fae1a67-6df4-475c-be08-6d3f18e4a08d tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:01.885894 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-6e7ec1fb-23c2-436f-8c59-124447fa202a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:01.894336 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6e7ec1fb-23c2-436f-8c59-124447fa202a tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1370 microversion: 2.1 time: 0.211537 May 28 17:29:01.894917 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 244/503] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:01 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1370 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:01.947096 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5fae1a67-6df4-475c-be08-6d3f18e4a08d tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:01.954404 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5fae1a67-6df4-475c-be08-6d3f18e4a08d tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61" status: 200 len: 1215 microversion: 2.1 time: 0.082749 May 28 17:29:01.954952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 260/504] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:01 2022] GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61 => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:29:02.526952 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6552b264-bd37-452d-8c0e-252c1dc3531f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:02.527600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6552b264-bd37-452d-8c0e-252c1dc3531f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:02.533682 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6552b264-bd37-452d-8c0e-252c1dc3531f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:02.534184 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6552b264-bd37-452d-8c0e-252c1dc3531f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:02.534964 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6552b264-bd37-452d-8c0e-252c1dc3531f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:02.535435 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6552b264-bd37-452d-8c0e-252c1dc3531f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:02.598101 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-6552b264-bd37-452d-8c0e-252c1dc3531f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:02.605412 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6552b264-bd37-452d-8c0e-252c1dc3531f tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9" status: 200 len: 1271 microversion: 2.1 time: 0.082305 May 28 17:29:02.605983 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 245/505] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:02 2022] GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:02.838396 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-51e3bfd5-dec4-4a99-93ab-03a255c8a7b9 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:02.839037 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-51e3bfd5-dec4-4a99-93ab-03a255c8a7b9 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:02.845935 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-51e3bfd5-dec4-4a99-93ab-03a255c8a7b9 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:02.846445 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-51e3bfd5-dec4-4a99-93ab-03a255c8a7b9 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:02.847212 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-51e3bfd5-dec4-4a99-93ab-03a255c8a7b9 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:02.847685 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-51e3bfd5-dec4-4a99-93ab-03a255c8a7b9 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:02.911307 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-23f29567-8e63-4307-8aa0-fa34e55eb23b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:02.912816 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-23f29567-8e63-4307-8aa0-fa34e55eb23b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:02.920717 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-23f29567-8e63-4307-8aa0-fa34e55eb23b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:02.921405 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-23f29567-8e63-4307-8aa0-fa34e55eb23b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:02.922521 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-23f29567-8e63-4307-8aa0-fa34e55eb23b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:02.923037 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-23f29567-8e63-4307-8aa0-fa34e55eb23b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:02.926964 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:29:03.164455 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-23f29567-8e63-4307-8aa0-fa34e55eb23b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:03.172005 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-23f29567-8e63-4307-8aa0-fa34e55eb23b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1370 microversion: 2.1 time: 0.265597 May 28 17:29:03.172665 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 246/506] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:02 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1370 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:29:03.177349 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f35410f8-751b-41e0-ad46-4c0496b43f83 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:03.178034 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f35410f8-751b-41e0-ad46-4c0496b43f83 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: a3819481-ecb7-47a2-86b2-78c6c1c40d61] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:03.184001 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f35410f8-751b-41e0-ad46-4c0496b43f83 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:03.184456 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f35410f8-751b-41e0-ad46-4c0496b43f83 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:03.185227 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f35410f8-751b-41e0-ad46-4c0496b43f83 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:03.185667 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f35410f8-751b-41e0-ad46-4c0496b43f83 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:03.249243 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f35410f8-751b-41e0-ad46-4c0496b43f83 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:03.258007 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f35410f8-751b-41e0-ad46-4c0496b43f83 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61" status: 200 len: 1277 microversion: 2.1 time: 0.084284 May 28 17:29:03.258719 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 247/507] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:03 2022] GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61 => generated 1277 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:03.265964 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-51e3bfd5-dec4-4a99-93ab-03a255c8a7b9 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:03.275459 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-51e3bfd5-dec4-4a99-93ab-03a255c8a7b9 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1593 microversion: 2.1 time: 0.441097 May 28 17:29:03.276077 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 261/508] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:02 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1593 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:03.623585 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c6435149-a057-4bca-8bce-786508a59e22 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:03.624852 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c6435149-a057-4bca-8bce-786508a59e22 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:03.631877 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c6435149-a057-4bca-8bce-786508a59e22 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:03.632703 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c6435149-a057-4bca-8bce-786508a59e22 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:03.633697 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c6435149-a057-4bca-8bce-786508a59e22 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:03.634221 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c6435149-a057-4bca-8bce-786508a59e22 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:03.703891 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c6435149-a057-4bca-8bce-786508a59e22 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:03.712550 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c6435149-a057-4bca-8bce-786508a59e22 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9" status: 200 len: 1271 microversion: 2.1 time: 0.092715 May 28 17:29:03.713713 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 248/509] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:03 2022] GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:04.189102 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5b0d0b28-f13c-42aa-b519-87371faff7aa tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:04.190695 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5b0d0b28-f13c-42aa-b519-87371faff7aa tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:04.198014 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5b0d0b28-f13c-42aa-b519-87371faff7aa tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:04.198862 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5b0d0b28-f13c-42aa-b519-87371faff7aa tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:04.200257 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5b0d0b28-f13c-42aa-b519-87371faff7aa tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:04.201171 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5b0d0b28-f13c-42aa-b519-87371faff7aa tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:04.276207 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6da6b74a-ec61-4d2c-b17b-97b605e7d890 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:04.277582 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6da6b74a-ec61-4d2c-b17b-97b605e7d890 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: a3819481-ecb7-47a2-86b2-78c6c1c40d61] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:04.284632 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6da6b74a-ec61-4d2c-b17b-97b605e7d890 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:04.285532 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6da6b74a-ec61-4d2c-b17b-97b605e7d890 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:04.286429 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6da6b74a-ec61-4d2c-b17b-97b605e7d890 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:04.286976 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6da6b74a-ec61-4d2c-b17b-97b605e7d890 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:04.539822 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-6da6b74a-ec61-4d2c-b17b-97b605e7d890 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:04.548952 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6da6b74a-ec61-4d2c-b17b-97b605e7d890 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61" status: 200 len: 1319 microversion: 2.1 time: 0.277344 May 28 17:29:04.550809 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 249/510] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:04 2022] GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61 => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:29:04.563372 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5b0d0b28-f13c-42aa-b519-87371faff7aa tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:04.572219 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5b0d0b28-f13c-42aa-b519-87371faff7aa tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1370 microversion: 2.1 time: 0.386947 May 28 17:29:04.572976 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 262/511] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:04 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1370 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:04.734094 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d7426b5b-98e1-4a9d-aedc-c4247f12026d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:04.735222 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d7426b5b-98e1-4a9d-aedc-c4247f12026d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:04.743586 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d7426b5b-98e1-4a9d-aedc-c4247f12026d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:04.744204 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d7426b5b-98e1-4a9d-aedc-c4247f12026d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:04.745174 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d7426b5b-98e1-4a9d-aedc-c4247f12026d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:04.745613 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d7426b5b-98e1-4a9d-aedc-c4247f12026d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:05.018873 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d7426b5b-98e1-4a9d-aedc-c4247f12026d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:05.030655 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d7426b5b-98e1-4a9d-aedc-c4247f12026d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9" status: 200 len: 1313 microversion: 2.1 time: 0.302503 May 28 17:29:05.031605 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 250/512] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:04 2022] GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:05.447868 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-78359698-35b5-4792-93df-7fa7b2fd01c4 req-1e0e5c62-e14b-4b4f-bf9d-d4d59de73d34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8aeee30e-c713-4fbf-8264-6a47cb986bf9", "tag": "0bf565cf-1c8d-411c-9424-951d8df39dbe"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:29:05.450461 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-0308ebc0-02db-42e2-b8b7-65b40df90327 req-586a96c7-b78c-49c4-9248-e8a723d6a28d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c454eafd-57ce-466c-a88f-aa88a272a56a", "tag": "f6092e8b-c7e1-4c14-a7b3-8baa64e42a95"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:29:05.461550 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-0308ebc0-02db-42e2-b8b7-65b40df90327 req-586a96c7-b78c-49c4-9248-e8a723d6a28d service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:05.462271 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-0308ebc0-02db-42e2-b8b7-65b40df90327 req-586a96c7-b78c-49c4-9248-e8a723d6a28d service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:05.470442 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:29:05.476200 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-0308ebc0-02db-42e2-b8b7-65b40df90327 req-586a96c7-b78c-49c4-9248-e8a723d6a28d service nova] Creating event network-changed:f6092e8b-c7e1-4c14-a7b3-8baa64e42a95 for instance c454eafd-57ce-466c-a88f-aa88a272a56a on hv-cinder-84372 May 28 17:29:05.483759 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-78359698-35b5-4792-93df-7fa7b2fd01c4 req-1e0e5c62-e14b-4b4f-bf9d-d4d59de73d34 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:05.484767 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-78359698-35b5-4792-93df-7fa7b2fd01c4 req-1e0e5c62-e14b-4b4f-bf9d-d4d59de73d34 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:05.494641 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-0308ebc0-02db-42e2-b8b7-65b40df90327 req-586a96c7-b78c-49c4-9248-e8a723d6a28d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038369 May 28 17:29:05.499266 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 251/513] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:29:05.504083 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-78359698-35b5-4792-93df-7fa7b2fd01c4 req-1e0e5c62-e14b-4b4f-bf9d-d4d59de73d34 service nova] Creating event network-changed:0bf565cf-1c8d-411c-9424-951d8df39dbe for instance 8aeee30e-c713-4fbf-8264-6a47cb986bf9 on hv-cinder-84372 May 28 17:29:05.510788 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-78359698-35b5-4792-93df-7fa7b2fd01c4 req-1e0e5c62-e14b-4b4f-bf9d-d4d59de73d34 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079409 May 28 17:29:05.511734 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 263/514] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:29:05.572352 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9c44d246-c3c6-431b-87cb-ab65b55c3490 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:05.573576 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9c44d246-c3c6-431b-87cb-ab65b55c3490 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: a3819481-ecb7-47a2-86b2-78c6c1c40d61] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:05.582683 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9c44d246-c3c6-431b-87cb-ab65b55c3490 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:05.583585 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9c44d246-c3c6-431b-87cb-ab65b55c3490 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:05.584681 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9c44d246-c3c6-431b-87cb-ab65b55c3490 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:05.585367 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9c44d246-c3c6-431b-87cb-ab65b55c3490 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:05.593500 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f825cc64-6300-42a3-a243-5e7d5d12e119 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:05.595559 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f825cc64-6300-42a3-a243-5e7d5d12e119 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:05.604217 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f825cc64-6300-42a3-a243-5e7d5d12e119 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:05.604983 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f825cc64-6300-42a3-a243-5e7d5d12e119 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:05.606014 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f825cc64-6300-42a3-a243-5e7d5d12e119 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:05.607281 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f825cc64-6300-42a3-a243-5e7d5d12e119 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:05.836970 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-9c44d246-c3c6-431b-87cb-ab65b55c3490 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:05.844613 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9c44d246-c3c6-431b-87cb-ab65b55c3490 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61" status: 200 len: 1319 microversion: 2.1 time: 0.279647 May 28 17:29:05.855315 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 252/515] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:05 2022] GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61 => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:05.960846 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f825cc64-6300-42a3-a243-5e7d5d12e119 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:05.976292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f825cc64-6300-42a3-a243-5e7d5d12e119 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1370 microversion: 2.1 time: 0.389662 May 28 17:29:05.977519 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 264/516] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:05 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1370 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:06.054866 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-30bcad68-f1a3-43e1-ba3f-8137303203c6 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:06.055583 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-30bcad68-f1a3-43e1-ba3f-8137303203c6 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:06.066794 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-30bcad68-f1a3-43e1-ba3f-8137303203c6 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:06.067255 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-30bcad68-f1a3-43e1-ba3f-8137303203c6 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:06.068072 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-30bcad68-f1a3-43e1-ba3f-8137303203c6 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:06.068513 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-30bcad68-f1a3-43e1-ba3f-8137303203c6 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:06.248448 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-a5790748-0834-4110-8e62-a17e1871421f req-9093012c-82f3-44b5-9875-06ed8920ecf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435314f8-f9b7-4e9c-94f3-8a84190965b9", "name": "network-vif-plugged", "status": "completed", "tag": "5ea754ee-2216-4168-ad09-190faba5d36c"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:29:06.265613 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-a5790748-0834-4110-8e62-a17e1871421f req-9093012c-82f3-44b5-9875-06ed8920ecf8 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:06.266925 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-a5790748-0834-4110-8e62-a17e1871421f req-9093012c-82f3-44b5-9875-06ed8920ecf8 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:06.297604 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-a5790748-0834-4110-8e62-a17e1871421f req-9093012c-82f3-44b5-9875-06ed8920ecf8 service nova] Creating event network-vif-plugged:5ea754ee-2216-4168-ad09-190faba5d36c for instance 435314f8-f9b7-4e9c-94f3-8a84190965b9 on hv-cinder-84372 May 28 17:29:06.311287 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-a5790748-0834-4110-8e62-a17e1871421f req-9093012c-82f3-44b5-9875-06ed8920ecf8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060543 May 28 17:29:06.312135 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 265/517] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:29:06.750806 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-30bcad68-f1a3-43e1-ba3f-8137303203c6 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:06.767885 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-30bcad68-f1a3-43e1-ba3f-8137303203c6 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9" status: 200 len: 1313 microversion: 2.1 time: 0.722725 May 28 17:29:06.768974 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 253/518] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:06 2022] GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 => generated 1313 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:06.866023 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9b77a9ad-b1ed-4e1e-b1dc-2d8f8dcdac1a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:06.867514 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9b77a9ad-b1ed-4e1e-b1dc-2d8f8dcdac1a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: a3819481-ecb7-47a2-86b2-78c6c1c40d61] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:06.876547 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9b77a9ad-b1ed-4e1e-b1dc-2d8f8dcdac1a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:06.877319 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9b77a9ad-b1ed-4e1e-b1dc-2d8f8dcdac1a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:06.878390 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9b77a9ad-b1ed-4e1e-b1dc-2d8f8dcdac1a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:06.879062 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9b77a9ad-b1ed-4e1e-b1dc-2d8f8dcdac1a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:06.995250 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-03c115e4-f8be-4bcd-9bae-f712979b176f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:06.996058 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-03c115e4-f8be-4bcd-9bae-f712979b176f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:07.005139 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-03c115e4-f8be-4bcd-9bae-f712979b176f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:07.005733 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-03c115e4-f8be-4bcd-9bae-f712979b176f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:07.006636 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-03c115e4-f8be-4bcd-9bae-f712979b176f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:07.007302 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-03c115e4-f8be-4bcd-9bae-f712979b176f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:07.035489 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9b77a9ad-b1ed-4e1e-b1dc-2d8f8dcdac1a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:07.046540 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9b77a9ad-b1ed-4e1e-b1dc-2d8f8dcdac1a tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61" status: 200 len: 1319 microversion: 2.1 time: 0.187578 May 28 17:29:07.047447 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 266/519] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:06 2022] GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:07.169116 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-03c115e4-f8be-4bcd-9bae-f712979b176f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:07.176843 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-03c115e4-f8be-4bcd-9bae-f712979b176f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1370 microversion: 2.1 time: 0.186574 May 28 17:29:07.177462 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 254/520] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:06 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:29:07.461154 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9b222795-ba31-4465-86bb-081b3953d9fe tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-295021337"}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:29:07.461723 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9b222795-ba31-4465-86bb-081b3953d9fe tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:07.467727 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9b222795-ba31-4465-86bb-081b3953d9fe tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:07.468163 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9b222795-ba31-4465-86bb-081b3953d9fe tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:07.468922 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9b222795-ba31-4465-86bb-081b3953d9fe tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:07.469360 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9b222795-ba31-4465-86bb-081b3953d9fe tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:07.531839 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-79a05083-19fb-45a2-82e2-1fb2ab2e5a94 req-3237d047-d071-4e4e-a7d2-be35d9db7e81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3819481-ecb7-47a2-86b2-78c6c1c40d61", "tag": "e2176952-8c79-446f-97c9-b6c6820083b3"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:29:07.541006 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-79a05083-19fb-45a2-82e2-1fb2ab2e5a94 req-3237d047-d071-4e4e-a7d2-be35d9db7e81 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:07.541456 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-79a05083-19fb-45a2-82e2-1fb2ab2e5a94 req-3237d047-d071-4e4e-a7d2-be35d9db7e81 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:07.553697 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-79a05083-19fb-45a2-82e2-1fb2ab2e5a94 req-3237d047-d071-4e4e-a7d2-be35d9db7e81 service nova] Creating event network-changed:e2176952-8c79-446f-97c9-b6c6820083b3 for instance a3819481-ecb7-47a2-86b2-78c6c1c40d61 on hv-cinder-84372 May 28 17:29:07.558653 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-79a05083-19fb-45a2-82e2-1fb2ab2e5a94 req-3237d047-d071-4e4e-a7d2-be35d9db7e81 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030859 May 28 17:29:07.559255 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 255/521] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:29:07.611672 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.network.security_group_api [None req-9b222795-ba31-4465-86bb-081b3953d9fe tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Adding security group ca3cb093-79be-42e6-83d5-849146a5ec7b to port f6092e8b-c7e1-4c14-a7b3-8baa64e42a95 May 28 17:29:07.786505 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b1fbb542-8063-48b8-ac6b-3965c88998d5 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:07.787416 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-b1fbb542-8063-48b8-ac6b-3965c88998d5 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:07.793573 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b1fbb542-8063-48b8-ac6b-3965c88998d5 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:07.794025 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b1fbb542-8063-48b8-ac6b-3965c88998d5 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:07.794796 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b1fbb542-8063-48b8-ac6b-3965c88998d5 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:07.795239 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b1fbb542-8063-48b8-ac6b-3965c88998d5 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:07.930314 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b1fbb542-8063-48b8-ac6b-3965c88998d5 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:07.937637 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b1fbb542-8063-48b8-ac6b-3965c88998d5 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9" status: 200 len: 1313 microversion: 2.1 time: 0.155589 May 28 17:29:07.938202 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 256/522] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:07 2022] GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:29:07.998712 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9b222795-ba31-4465-86bb-081b3953d9fe tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "POST /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a/action" status: 202 len: 0 microversion: 2.1 time: 0.541465 May 28 17:29:08.004550 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 267/523] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 17:29:07 2022] POST /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a/action => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 17:29:08.009428 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c02bb60b-47b1-4408-a6fb-cdb8b7ca9acb tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:08.010042 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c02bb60b-47b1-4408-a6fb-cdb8b7ca9acb tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:08.016423 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c02bb60b-47b1-4408-a6fb-cdb8b7ca9acb tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:08.017590 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c02bb60b-47b1-4408-a6fb-cdb8b7ca9acb tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:08.018751 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c02bb60b-47b1-4408-a6fb-cdb8b7ca9acb tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:08.021188 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c02bb60b-47b1-4408-a6fb-cdb8b7ca9acb tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:08.066522 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-41936acf-55f3-41c1-90ad-c5539c667a29 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:08.067536 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-41936acf-55f3-41c1-90ad-c5539c667a29 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: a3819481-ecb7-47a2-86b2-78c6c1c40d61] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:08.074032 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-41936acf-55f3-41c1-90ad-c5539c667a29 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:08.074735 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-41936acf-55f3-41c1-90ad-c5539c667a29 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:08.075705 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-41936acf-55f3-41c1-90ad-c5539c667a29 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:08.076297 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-41936acf-55f3-41c1-90ad-c5539c667a29 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:08.192084 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c02bb60b-47b1-4408-a6fb-cdb8b7ca9acb tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:08.202348 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c02bb60b-47b1-4408-a6fb-cdb8b7ca9acb tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1758 microversion: 2.1 time: 0.196496 May 28 17:29:08.203355 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 257/524] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:08 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1758 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:29:08.218138 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7d542044-7178-4b85-89b6-d10793a8aebc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:08.218762 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7d542044-7178-4b85-89b6-d10793a8aebc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:08.225460 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7d542044-7178-4b85-89b6-d10793a8aebc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:08.226165 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7d542044-7178-4b85-89b6-d10793a8aebc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:08.227118 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7d542044-7178-4b85-89b6-d10793a8aebc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:08.227744 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7d542044-7178-4b85-89b6-d10793a8aebc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:08.233081 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-41936acf-55f3-41c1-90ad-c5539c667a29 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:08.242552 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-41936acf-55f3-41c1-90ad-c5539c667a29 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61" status: 200 len: 1319 microversion: 2.1 time: 0.181962 May 28 17:29:08.243243 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 268/525] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:08 2022] GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:29:08.363439 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7d542044-7178-4b85-89b6-d10793a8aebc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:08.371189 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7d542044-7178-4b85-89b6-d10793a8aebc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1370 microversion: 2.1 time: 0.162130 May 28 17:29:08.371791 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 258/526] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:08 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:08.955406 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f2412b18-4a99-488c-b2f8-80241b7859ec tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:08.956065 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f2412b18-4a99-488c-b2f8-80241b7859ec tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:08.962708 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f2412b18-4a99-488c-b2f8-80241b7859ec tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:08.963201 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f2412b18-4a99-488c-b2f8-80241b7859ec tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:08.964014 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f2412b18-4a99-488c-b2f8-80241b7859ec tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:08.964502 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f2412b18-4a99-488c-b2f8-80241b7859ec tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:09.094284 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f2412b18-4a99-488c-b2f8-80241b7859ec tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:09.102334 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f2412b18-4a99-488c-b2f8-80241b7859ec tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9" status: 200 len: 1313 microversion: 2.1 time: 0.150865 May 28 17:29:09.102893 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 269/527] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:08 2022] GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:09.260012 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9eccb5bc-56a0-4c00-a35b-b3126ce1d660 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:09.260566 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9eccb5bc-56a0-4c00-a35b-b3126ce1d660 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: a3819481-ecb7-47a2-86b2-78c6c1c40d61] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:09.267036 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9eccb5bc-56a0-4c00-a35b-b3126ce1d660 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:09.267541 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9eccb5bc-56a0-4c00-a35b-b3126ce1d660 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:09.268861 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9eccb5bc-56a0-4c00-a35b-b3126ce1d660 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:09.269476 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9eccb5bc-56a0-4c00-a35b-b3126ce1d660 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:09.388869 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-99fbc673-3773-4dcf-a70f-552d0d48bf62 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:09.389480 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-99fbc673-3773-4dcf-a70f-552d0d48bf62 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:09.396083 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-99fbc673-3773-4dcf-a70f-552d0d48bf62 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:09.396534 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-99fbc673-3773-4dcf-a70f-552d0d48bf62 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:09.397297 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-99fbc673-3773-4dcf-a70f-552d0d48bf62 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:09.397735 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-99fbc673-3773-4dcf-a70f-552d0d48bf62 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:09.400974 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-9eccb5bc-56a0-4c00-a35b-b3126ce1d660 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:09.408553 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9eccb5bc-56a0-4c00-a35b-b3126ce1d660 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61" status: 200 len: 1319 microversion: 2.1 time: 0.152163 May 28 17:29:09.409796 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 259/528] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:09 2022] GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:09.525116 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-99fbc673-3773-4dcf-a70f-552d0d48bf62 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:09.532484 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-99fbc673-3773-4dcf-a70f-552d0d48bf62 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1370 microversion: 2.1 time: 0.147436 May 28 17:29:09.533047 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 270/529] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:09 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:29:09.572492 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-2ede2ba3-480f-462e-a155-07597ab2f203 req-3365e0b1-0f5b-4c10-b9f5-6eb187d85253 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c454eafd-57ce-466c-a88f-aa88a272a56a", "tag": "f6092e8b-c7e1-4c14-a7b3-8baa64e42a95"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:29:09.580397 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-2ede2ba3-480f-462e-a155-07597ab2f203 req-3365e0b1-0f5b-4c10-b9f5-6eb187d85253 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:09.581366 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-2ede2ba3-480f-462e-a155-07597ab2f203 req-3365e0b1-0f5b-4c10-b9f5-6eb187d85253 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:09.591751 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-2ede2ba3-480f-462e-a155-07597ab2f203 req-3365e0b1-0f5b-4c10-b9f5-6eb187d85253 service nova] Creating event network-changed:f6092e8b-c7e1-4c14-a7b3-8baa64e42a95 for instance c454eafd-57ce-466c-a88f-aa88a272a56a on hv-cinder-84372 May 28 17:29:09.597026 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-2ede2ba3-480f-462e-a155-07597ab2f203 req-3365e0b1-0f5b-4c10-b9f5-6eb187d85253 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027666 May 28 17:29:09.597671 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 260/530] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:29:10.121033 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8dcf8f4e-c59d-4df4-83c3-631812a32788 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:10.121569 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8dcf8f4e-c59d-4df4-83c3-631812a32788 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:10.123528 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=10 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:29:10.130117 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8dcf8f4e-c59d-4df4-83c3-631812a32788 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:10.130565 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8dcf8f4e-c59d-4df4-83c3-631812a32788 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:10.131328 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8dcf8f4e-c59d-4df4-83c3-631812a32788 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:10.131789 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8dcf8f4e-c59d-4df4-83c3-631812a32788 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:10.264856 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8dcf8f4e-c59d-4df4-83c3-631812a32788 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:10.272290 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8dcf8f4e-c59d-4df4-83c3-631812a32788 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9" status: 200 len: 1313 microversion: 2.1 time: 0.156058 May 28 17:29:10.272877 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 271/531] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:10 2022] GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:10.423310 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=2 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:29:10.424024 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=18 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:29:10.429419 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f59176da-3e94-4aeb-942a-bb9771fc9cf1 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:10.430127 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f59176da-3e94-4aeb-942a-bb9771fc9cf1 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: a3819481-ecb7-47a2-86b2-78c6c1c40d61] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:10.437162 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f59176da-3e94-4aeb-942a-bb9771fc9cf1 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:10.437613 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f59176da-3e94-4aeb-942a-bb9771fc9cf1 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:10.438375 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f59176da-3e94-4aeb-942a-bb9771fc9cf1 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:10.438813 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f59176da-3e94-4aeb-942a-bb9771fc9cf1 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:10.551911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-99ead468-c554-4a7b-83b9-99441450dee4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:10.552629 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-99ead468-c554-4a7b-83b9-99441450dee4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:10.559254 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-99ead468-c554-4a7b-83b9-99441450dee4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:10.559732 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-99ead468-c554-4a7b-83b9-99441450dee4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:10.560493 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-99ead468-c554-4a7b-83b9-99441450dee4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:10.560925 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-99ead468-c554-4a7b-83b9-99441450dee4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:10.569843 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f59176da-3e94-4aeb-942a-bb9771fc9cf1 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:10.577428 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f59176da-3e94-4aeb-942a-bb9771fc9cf1 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61" status: 200 len: 1319 microversion: 2.1 time: 0.155128 May 28 17:29:10.578366 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 261/532] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:10 2022] GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:10.692218 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-99ead468-c554-4a7b-83b9-99441450dee4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:10.699626 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-99ead468-c554-4a7b-83b9-99441450dee4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1370 microversion: 2.1 time: 0.153614 May 28 17:29:10.700186 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 272/533] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:10 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:11.289776 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4128ae42-f91b-4261-a47f-767b528bd3cc tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:11.290403 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4128ae42-f91b-4261-a47f-767b528bd3cc tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:11.296576 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4128ae42-f91b-4261-a47f-767b528bd3cc tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:11.297046 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4128ae42-f91b-4261-a47f-767b528bd3cc tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:11.297839 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4128ae42-f91b-4261-a47f-767b528bd3cc tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:11.298290 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4128ae42-f91b-4261-a47f-767b528bd3cc tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:11.428457 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4128ae42-f91b-4261-a47f-767b528bd3cc tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:11.436592 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4128ae42-f91b-4261-a47f-767b528bd3cc tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9" status: 200 len: 1313 microversion: 2.1 time: 0.150597 May 28 17:29:11.437153 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 262/534] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:11 2022] GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:11.593996 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-466e2848-a304-4725-bd05-c692c2da7759 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:11.594507 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-466e2848-a304-4725-bd05-c692c2da7759 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: a3819481-ecb7-47a2-86b2-78c6c1c40d61] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:11.601725 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-466e2848-a304-4725-bd05-c692c2da7759 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:11.602172 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-466e2848-a304-4725-bd05-c692c2da7759 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:11.602966 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-466e2848-a304-4725-bd05-c692c2da7759 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:11.603432 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-466e2848-a304-4725-bd05-c692c2da7759 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:11.606024 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=100 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:29:11.716784 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7104202d-57d0-4adf-a4a5-e771e8d3e998 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:11.717410 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7104202d-57d0-4adf-a4a5-e771e8d3e998 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:11.725450 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7104202d-57d0-4adf-a4a5-e771e8d3e998 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:11.725909 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7104202d-57d0-4adf-a4a5-e771e8d3e998 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:11.726704 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7104202d-57d0-4adf-a4a5-e771e8d3e998 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:11.727126 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7104202d-57d0-4adf-a4a5-e771e8d3e998 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:11.739782 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-466e2848-a304-4725-bd05-c692c2da7759 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:11.748243 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-466e2848-a304-4725-bd05-c692c2da7759 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61" status: 200 len: 1319 microversion: 2.1 time: 0.158187 May 28 17:29:11.748808 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 273/535] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:11 2022] GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:11.859776 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7104202d-57d0-4adf-a4a5-e771e8d3e998 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:11.867708 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7104202d-57d0-4adf-a4a5-e771e8d3e998 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1370 microversion: 2.1 time: 0.155243 May 28 17:29:11.868273 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 263/536] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:11 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:29:12.454459 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-fd49bec6-48cc-41b2-b008-d22d1b52123d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:12.455207 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-fd49bec6-48cc-41b2-b008-d22d1b52123d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:12.462357 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fd49bec6-48cc-41b2-b008-d22d1b52123d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:12.462808 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fd49bec6-48cc-41b2-b008-d22d1b52123d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:12.463613 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fd49bec6-48cc-41b2-b008-d22d1b52123d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:12.464055 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fd49bec6-48cc-41b2-b008-d22d1b52123d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:12.595314 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-fd49bec6-48cc-41b2-b008-d22d1b52123d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:12.604668 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-fd49bec6-48cc-41b2-b008-d22d1b52123d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9" status: 200 len: 1313 microversion: 2.1 time: 0.154516 May 28 17:29:12.605227 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 274/537] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:12 2022] GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:12.766445 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6fe4deba-0ebd-4759-b6de-3d0386b41fad tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:12.767229 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6fe4deba-0ebd-4759-b6de-3d0386b41fad tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: a3819481-ecb7-47a2-86b2-78c6c1c40d61] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:12.774959 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6fe4deba-0ebd-4759-b6de-3d0386b41fad tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:12.775522 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6fe4deba-0ebd-4759-b6de-3d0386b41fad tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:12.776350 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6fe4deba-0ebd-4759-b6de-3d0386b41fad tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:12.776790 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6fe4deba-0ebd-4759-b6de-3d0386b41fad tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:12.884612 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b1578cbc-f06b-4e9f-9253-9b382dc1b74f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:12.885225 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b1578cbc-f06b-4e9f-9253-9b382dc1b74f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:12.891187 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b1578cbc-f06b-4e9f-9253-9b382dc1b74f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:12.891664 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b1578cbc-f06b-4e9f-9253-9b382dc1b74f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:12.892429 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b1578cbc-f06b-4e9f-9253-9b382dc1b74f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:12.892864 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b1578cbc-f06b-4e9f-9253-9b382dc1b74f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:12.912654 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-6fe4deba-0ebd-4759-b6de-3d0386b41fad tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:12.914794 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=100 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:29:12.921464 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6fe4deba-0ebd-4759-b6de-3d0386b41fad tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61" status: 200 len: 1319 microversion: 2.1 time: 0.158999 May 28 17:29:12.922021 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 264/538] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:12 2022] GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:13.031408 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b1578cbc-f06b-4e9f-9253-9b382dc1b74f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:13.042246 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b1578cbc-f06b-4e9f-9253-9b382dc1b74f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1370 microversion: 2.1 time: 0.161413 May 28 17:29:13.042825 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 275/539] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:12 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:29:13.621797 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-cc13ae69-330d-41e6-bee9-44a6e719ffb4 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:13.622401 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-cc13ae69-330d-41e6-bee9-44a6e719ffb4 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:13.628552 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cc13ae69-330d-41e6-bee9-44a6e719ffb4 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:13.629029 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cc13ae69-330d-41e6-bee9-44a6e719ffb4 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:13.629783 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cc13ae69-330d-41e6-bee9-44a6e719ffb4 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:13.630241 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cc13ae69-330d-41e6-bee9-44a6e719ffb4 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:13.760148 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-cc13ae69-330d-41e6-bee9-44a6e719ffb4 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:13.767407 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-cc13ae69-330d-41e6-bee9-44a6e719ffb4 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9" status: 200 len: 1313 microversion: 2.1 time: 0.149589 May 28 17:29:13.768004 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 265/540] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:13 2022] GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:13.938184 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-871b1f86-b057-4997-9e58-53945fdb54e7 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:13.938819 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-871b1f86-b057-4997-9e58-53945fdb54e7 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: a3819481-ecb7-47a2-86b2-78c6c1c40d61] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:13.945313 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-871b1f86-b057-4997-9e58-53945fdb54e7 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:13.945762 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-871b1f86-b057-4997-9e58-53945fdb54e7 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:13.946516 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-871b1f86-b057-4997-9e58-53945fdb54e7 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:13.946947 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-871b1f86-b057-4997-9e58-53945fdb54e7 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:14.061028 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ff3889d9-0ec8-4ec4-a1cc-6dd6e7bee2e4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:14.061769 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ff3889d9-0ec8-4ec4-a1cc-6dd6e7bee2e4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:14.068233 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ff3889d9-0ec8-4ec4-a1cc-6dd6e7bee2e4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:14.068695 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ff3889d9-0ec8-4ec4-a1cc-6dd6e7bee2e4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:14.070409 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ff3889d9-0ec8-4ec4-a1cc-6dd6e7bee2e4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:14.070860 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ff3889d9-0ec8-4ec4-a1cc-6dd6e7bee2e4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:14.079774 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-871b1f86-b057-4997-9e58-53945fdb54e7 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:14.089096 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-871b1f86-b057-4997-9e58-53945fdb54e7 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61" status: 200 len: 1319 microversion: 2.1 time: 0.154801 May 28 17:29:14.090564 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 276/541] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:13 2022] GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:14.206118 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ff3889d9-0ec8-4ec4-a1cc-6dd6e7bee2e4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:14.214059 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ff3889d9-0ec8-4ec4-a1cc-6dd6e7bee2e4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1370 microversion: 2.1 time: 0.157094 May 28 17:29:14.214625 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 266/542] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:14 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:29:14.348465 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-5a9a11e5-7a3a-4048-a1fc-29e406658e33 req-cd2b6145-01fd-48b9-81dd-8ec9e6ab6498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3819481-ecb7-47a2-86b2-78c6c1c40d61", "name": "network-vif-plugged", "status": "completed", "tag": "e2176952-8c79-446f-97c9-b6c6820083b3"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:29:14.357014 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-5a9a11e5-7a3a-4048-a1fc-29e406658e33 req-cd2b6145-01fd-48b9-81dd-8ec9e6ab6498 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:14.357506 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-5a9a11e5-7a3a-4048-a1fc-29e406658e33 req-cd2b6145-01fd-48b9-81dd-8ec9e6ab6498 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:14.368641 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-5a9a11e5-7a3a-4048-a1fc-29e406658e33 req-cd2b6145-01fd-48b9-81dd-8ec9e6ab6498 service nova] Creating event network-vif-plugged:e2176952-8c79-446f-97c9-b6c6820083b3 for instance a3819481-ecb7-47a2-86b2-78c6c1c40d61 on hv-cinder-84372 May 28 17:29:14.373528 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-5a9a11e5-7a3a-4048-a1fc-29e406658e33 req-cd2b6145-01fd-48b9-81dd-8ec9e6ab6498 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028907 May 28 17:29:14.374356 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 277/543] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:29:14.785455 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7696e29c-68f7-4949-bccf-2ced24222124 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:14.786075 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7696e29c-68f7-4949-bccf-2ced24222124 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:14.792279 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7696e29c-68f7-4949-bccf-2ced24222124 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:14.792737 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7696e29c-68f7-4949-bccf-2ced24222124 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:14.793519 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7696e29c-68f7-4949-bccf-2ced24222124 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:14.793958 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7696e29c-68f7-4949-bccf-2ced24222124 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:15.070405 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7696e29c-68f7-4949-bccf-2ced24222124 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:15.082037 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7696e29c-68f7-4949-bccf-2ced24222124 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9" status: 200 len: 1313 microversion: 2.1 time: 0.300135 May 28 17:29:15.084365 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 267/544] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:14 2022] GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:15.107523 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-7a88389f-835c-43ba-b461-cb6392cbb914 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:15.108401 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-7a88389f-835c-43ba-b461-cb6392cbb914 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: a3819481-ecb7-47a2-86b2-78c6c1c40d61] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:15.116566 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7a88389f-835c-43ba-b461-cb6392cbb914 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:15.117243 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7a88389f-835c-43ba-b461-cb6392cbb914 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:15.118351 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7a88389f-835c-43ba-b461-cb6392cbb914 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:15.119410 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7a88389f-835c-43ba-b461-cb6392cbb914 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:15.230074 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ca8dc8b6-7e11-46c3-a0dd-0b259f24b1cf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:15.230700 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ca8dc8b6-7e11-46c3-a0dd-0b259f24b1cf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:15.238697 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ca8dc8b6-7e11-46c3-a0dd-0b259f24b1cf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:15.239158 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ca8dc8b6-7e11-46c3-a0dd-0b259f24b1cf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:15.240079 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ca8dc8b6-7e11-46c3-a0dd-0b259f24b1cf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:15.240556 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ca8dc8b6-7e11-46c3-a0dd-0b259f24b1cf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:15.269333 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7a88389f-835c-43ba-b461-cb6392cbb914 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:15.276877 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-7a88389f-835c-43ba-b461-cb6392cbb914 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61" status: 200 len: 1319 microversion: 2.1 time: 0.174532 May 28 17:29:15.277538 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 278/545] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:15 2022] GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:15.282215 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d0cacc50-fe95-4950-81fa-a86097a82365 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:15.282707 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d0cacc50-fe95-4950-81fa-a86097a82365 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:15.289327 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d0cacc50-fe95-4950-81fa-a86097a82365 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:15.289785 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d0cacc50-fe95-4950-81fa-a86097a82365 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:15.290565 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d0cacc50-fe95-4950-81fa-a86097a82365 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:15.291007 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d0cacc50-fe95-4950-81fa-a86097a82365 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:15.314010 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d0cacc50-fe95-4950-81fa-a86097a82365 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512/ips" status: 200 len: 144 microversion: 2.1 time: 0.035367 May 28 17:29:15.314582 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 279/546] 10.222.0.33 () {58 vars in 1247 bytes} [Sat May 28 17:29:15 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512/ips => generated 144 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:29:15.374522 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ca8dc8b6-7e11-46c3-a0dd-0b259f24b1cf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:15.382121 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ca8dc8b6-7e11-46c3-a0dd-0b259f24b1cf tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1370 microversion: 2.1 time: 0.156066 May 28 17:29:15.382689 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 268/547] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:15 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:29:16.101918 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f6df7bd1-cd2c-49e4-a5ff-6dd5fe54baf7 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:16.102631 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f6df7bd1-cd2c-49e4-a5ff-6dd5fe54baf7 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:16.109238 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f6df7bd1-cd2c-49e4-a5ff-6dd5fe54baf7 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:16.109875 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f6df7bd1-cd2c-49e4-a5ff-6dd5fe54baf7 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:16.110525 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f6df7bd1-cd2c-49e4-a5ff-6dd5fe54baf7 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:16.111192 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f6df7bd1-cd2c-49e4-a5ff-6dd5fe54baf7 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:16.268511 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f6df7bd1-cd2c-49e4-a5ff-6dd5fe54baf7 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:16.277857 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f6df7bd1-cd2c-49e4-a5ff-6dd5fe54baf7 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9" status: 200 len: 1313 microversion: 2.1 time: 0.180486 May 28 17:29:16.278771 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 280/548] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:16 2022] GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:16.294878 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7a585620-daec-437d-879f-b88dd608c9d2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:16.295530 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7a585620-daec-437d-879f-b88dd608c9d2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: a3819481-ecb7-47a2-86b2-78c6c1c40d61] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:16.302678 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7a585620-daec-437d-879f-b88dd608c9d2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:16.303129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7a585620-daec-437d-879f-b88dd608c9d2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:16.303942 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7a585620-daec-437d-879f-b88dd608c9d2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:16.304374 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7a585620-daec-437d-879f-b88dd608c9d2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:16.398670 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-25a4d034-3941-4307-8455-b3c449048658 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:16.399292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-25a4d034-3941-4307-8455-b3c449048658 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:16.405501 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-25a4d034-3941-4307-8455-b3c449048658 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:16.405957 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-25a4d034-3941-4307-8455-b3c449048658 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:16.407418 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-25a4d034-3941-4307-8455-b3c449048658 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:16.407884 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-25a4d034-3941-4307-8455-b3c449048658 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:16.441615 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7a585620-daec-437d-879f-b88dd608c9d2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:16.449246 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7a585620-daec-437d-879f-b88dd608c9d2 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61" status: 200 len: 1319 microversion: 2.1 time: 0.158544 May 28 17:29:16.449826 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 269/549] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:16 2022] GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:16.538057 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-25a4d034-3941-4307-8455-b3c449048658 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:16.545552 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-25a4d034-3941-4307-8455-b3c449048658 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1564 microversion: 2.1 time: 0.150689 May 28 17:29:16.546306 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 281/550] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:16 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1564 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:16.562489 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-083c8cd7-d1b0-4a47-85ce-ddb0777bd7c6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:16.562994 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-083c8cd7-d1b0-4a47-85ce-ddb0777bd7c6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:16.569719 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-083c8cd7-d1b0-4a47-85ce-ddb0777bd7c6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:16.570098 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-083c8cd7-d1b0-4a47-85ce-ddb0777bd7c6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:16.570866 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-083c8cd7-d1b0-4a47-85ce-ddb0777bd7c6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:16.571313 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-083c8cd7-d1b0-4a47-85ce-ddb0777bd7c6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:16.652519 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-083c8cd7-d1b0-4a47-85ce-ddb0777bd7c6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093813 May 28 17:29:16.653138 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 270/551] 10.222.0.33 () {58 vars in 1274 bytes} [Sat May 28 17:29:16 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:29:17.272565 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e4bedc41-b019-4f68-9b60-bc3329819802 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5342cd3c-6160-4b9c-b932-90b80bcfec57"}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:29:17.273712 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e4bedc41-b019-4f68-9b60-bc3329819802 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:17.280209 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e4bedc41-b019-4f68-9b60-bc3329819802 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:17.280655 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e4bedc41-b019-4f68-9b60-bc3329819802 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:17.281410 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e4bedc41-b019-4f68-9b60-bc3329819802 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:17.281839 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e4bedc41-b019-4f68-9b60-bc3329819802 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:17.295204 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2bf7ae72-52b1-42b4-9235-6a0698fc3d5d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:17.295846 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2bf7ae72-52b1-42b4-9235-6a0698fc3d5d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:17.302176 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2bf7ae72-52b1-42b4-9235-6a0698fc3d5d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:17.302624 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2bf7ae72-52b1-42b4-9235-6a0698fc3d5d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:17.303518 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2bf7ae72-52b1-42b4-9235-6a0698fc3d5d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:17.303833 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2bf7ae72-52b1-42b4-9235-6a0698fc3d5d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:17.525488 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2bf7ae72-52b1-42b4-9235-6a0698fc3d5d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:17.541807 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2bf7ae72-52b1-42b4-9235-6a0698fc3d5d tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9" status: 200 len: 1313 microversion: 2.1 time: 0.250293 May 28 17:29:17.544562 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 271/552] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:17 2022] GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:29:17.551845 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d6bb2a67-ae14-4fab-9517-e7373b6b2170 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:17.552657 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d6bb2a67-ae14-4fab-9517-e7373b6b2170 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: a3819481-ecb7-47a2-86b2-78c6c1c40d61] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:17.560590 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d6bb2a67-ae14-4fab-9517-e7373b6b2170 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:17.561263 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d6bb2a67-ae14-4fab-9517-e7373b6b2170 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:17.562380 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d6bb2a67-ae14-4fab-9517-e7373b6b2170 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:17.563097 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d6bb2a67-ae14-4fab-9517-e7373b6b2170 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:17.879896 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d6bb2a67-ae14-4fab-9517-e7373b6b2170 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:17.887319 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d6bb2a67-ae14-4fab-9517-e7373b6b2170 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61" status: 200 len: 1319 microversion: 2.1 time: 0.341168 May 28 17:29:17.887917 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 272/553] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:17 2022] GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61 => generated 1319 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:17.892305 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-499ea293-29cf-4249-a48d-43deffae9b82 req-b8f2df4d-f7f6-4400-bd01-a667425dfcfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "435314f8-f9b7-4e9c-94f3-8a84190965b9", "tag": "5ea754ee-2216-4168-ad09-190faba5d36c"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:29:17.901164 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-499ea293-29cf-4249-a48d-43deffae9b82 req-b8f2df4d-f7f6-4400-bd01-a667425dfcfb service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:17.901656 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-499ea293-29cf-4249-a48d-43deffae9b82 req-b8f2df4d-f7f6-4400-bd01-a667425dfcfb service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:17.912661 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-499ea293-29cf-4249-a48d-43deffae9b82 req-b8f2df4d-f7f6-4400-bd01-a667425dfcfb service nova] Creating event network-changed:5ea754ee-2216-4168-ad09-190faba5d36c for instance 435314f8-f9b7-4e9c-94f3-8a84190965b9 on hv-cinder-84372 May 28 17:29:17.917599 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-499ea293-29cf-4249-a48d-43deffae9b82 req-b8f2df4d-f7f6-4400-bd01-a667425dfcfb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028600 May 28 17:29:17.918174 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 273/554] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:29:18.564887 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3151faa8-d40a-457b-ab85-34aa6ae2cb36 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:18.568124 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3151faa8-d40a-457b-ab85-34aa6ae2cb36 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:18.578273 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3151faa8-d40a-457b-ab85-34aa6ae2cb36 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:18.578774 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3151faa8-d40a-457b-ab85-34aa6ae2cb36 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:18.580254 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3151faa8-d40a-457b-ab85-34aa6ae2cb36 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:18.581775 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3151faa8-d40a-457b-ab85-34aa6ae2cb36 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:18.786517 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e4bedc41-b019-4f68-9b60-bc3329819802 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "POST /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.518432 May 28 17:29:18.787153 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 282/555] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 17:29:17 2022] POST /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512/os-volume_attachments => generated 194 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:29:18.805725 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-172ef453-faf6-4d22-bf53-6c5370a9922d req-0c8c6460-230a-4da3-a29d-71a8027f79fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aeee30e-c713-4fbf-8264-6a47cb986bf9", "name": "network-vif-plugged", "status": "completed", "tag": "0bf565cf-1c8d-411c-9424-951d8df39dbe"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:29:18.822719 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-172ef453-faf6-4d22-bf53-6c5370a9922d req-0c8c6460-230a-4da3-a29d-71a8027f79fa service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:18.823636 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-172ef453-faf6-4d22-bf53-6c5370a9922d req-0c8c6460-230a-4da3-a29d-71a8027f79fa service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:18.838796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-172ef453-faf6-4d22-bf53-6c5370a9922d req-0c8c6460-230a-4da3-a29d-71a8027f79fa service nova] Creating event network-vif-plugged:0bf565cf-1c8d-411c-9424-951d8df39dbe for instance 8aeee30e-c713-4fbf-8264-6a47cb986bf9 on hv-cinder-84372 May 28 17:29:18.845147 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-172ef453-faf6-4d22-bf53-6c5370a9922d req-0c8c6460-230a-4da3-a29d-71a8027f79fa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056378 May 28 17:29:18.847300 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 283/556] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:29:18.907027 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-030dac04-7ef7-4837-b101-ed1554e5cad8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:18.908454 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-030dac04-7ef7-4837-b101-ed1554e5cad8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: a3819481-ecb7-47a2-86b2-78c6c1c40d61] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:18.917411 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-030dac04-7ef7-4837-b101-ed1554e5cad8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:18.918018 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-030dac04-7ef7-4837-b101-ed1554e5cad8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:18.919077 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-030dac04-7ef7-4837-b101-ed1554e5cad8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:18.919768 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-030dac04-7ef7-4837-b101-ed1554e5cad8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:19.095994 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-030dac04-7ef7-4837-b101-ed1554e5cad8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:19.110444 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-030dac04-7ef7-4837-b101-ed1554e5cad8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61" status: 200 len: 1509 microversion: 2.1 time: 0.209204 May 28 17:29:19.111314 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 284/557] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:18 2022] GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61 => generated 1509 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:29:19.127161 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a06e737f-8061-4469-a8fd-99c76698261b tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe46da06-465c-4a3c-8408-475cd1153a58", "device": "/dev/sdb"}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:29:19.129154 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a06e737f-8061-4469-a8fd-99c76698261b tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: a3819481-ecb7-47a2-86b2-78c6c1c40d61] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:19.135930 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a06e737f-8061-4469-a8fd-99c76698261b tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:19.136385 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a06e737f-8061-4469-a8fd-99c76698261b tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:19.137430 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a06e737f-8061-4469-a8fd-99c76698261b tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:19.137871 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a06e737f-8061-4469-a8fd-99c76698261b tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:19.209344 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3151faa8-d40a-457b-ab85-34aa6ae2cb36 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:19.220692 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3151faa8-d40a-457b-ab85-34aa6ae2cb36 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9" status: 200 len: 1313 microversion: 2.1 time: 0.661779 May 28 17:29:19.221257 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 274/558] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:18 2022] GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 => generated 1313 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:29:20.108055 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a06e737f-8061-4469-a8fd-99c76698261b tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "POST /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.985002 May 28 17:29:20.108665 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 285/559] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 17:29:19 2022] POST /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61/os-volume_attachments => generated 194 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:29:20.237962 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-19f8269a-9449-4e81-9772-9f9e923f963e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:20.238692 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-19f8269a-9449-4e81-9772-9f9e923f963e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:20.245199 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-19f8269a-9449-4e81-9772-9f9e923f963e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:20.245643 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-19f8269a-9449-4e81-9772-9f9e923f963e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:20.246395 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-19f8269a-9449-4e81-9772-9f9e923f963e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:20.246825 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-19f8269a-9449-4e81-9772-9f9e923f963e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:20.373924 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-19f8269a-9449-4e81-9772-9f9e923f963e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:20.381905 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-19f8269a-9449-4e81-9772-9f9e923f963e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9" status: 200 len: 1313 microversion: 2.1 time: 0.148637 May 28 17:29:20.382457 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 275/560] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:20 2022] GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:21.399761 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f357ba18-81f4-436e-861f-a163553d1674 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:21.400384 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f357ba18-81f4-436e-861f-a163553d1674 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:21.406584 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f357ba18-81f4-436e-861f-a163553d1674 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:21.407032 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f357ba18-81f4-436e-861f-a163553d1674 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:21.407813 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f357ba18-81f4-436e-861f-a163553d1674 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:21.408250 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f357ba18-81f4-436e-861f-a163553d1674 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:21.536736 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f357ba18-81f4-436e-861f-a163553d1674 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:21.544180 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f357ba18-81f4-436e-861f-a163553d1674 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9" status: 200 len: 1313 microversion: 2.1 time: 0.149332 May 28 17:29:21.544749 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 286/561] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:21 2022] GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:22.561849 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e318b73f-9b53-4b42-8549-58bc59854c17 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:22.562374 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-e318b73f-9b53-4b42-8549-58bc59854c17 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:22.569181 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e318b73f-9b53-4b42-8549-58bc59854c17 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:22.569639 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e318b73f-9b53-4b42-8549-58bc59854c17 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:22.570402 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e318b73f-9b53-4b42-8549-58bc59854c17 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:22.570842 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e318b73f-9b53-4b42-8549-58bc59854c17 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:22.697089 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-e318b73f-9b53-4b42-8549-58bc59854c17 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:22.704384 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-e318b73f-9b53-4b42-8549-58bc59854c17 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9" status: 200 len: 1496 microversion: 2.1 time: 0.146463 May 28 17:29:22.704936 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 276/562] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:22 2022] GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 => generated 1496 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:23.310617 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-fd8a98fa-246b-451d-8c36-70657a572a30 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:23.311136 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-fd8a98fa-246b-451d-8c36-70657a572a30 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:23.318450 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fd8a98fa-246b-451d-8c36-70657a572a30 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:23.318974 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fd8a98fa-246b-451d-8c36-70657a572a30 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:23.319875 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fd8a98fa-246b-451d-8c36-70657a572a30 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:23.320307 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fd8a98fa-246b-451d-8c36-70657a572a30 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:23.345607 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-fd8a98fa-246b-451d-8c36-70657a572a30 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Going to try to terminate instance {{(pid=117604) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 17:29:23.377086 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:29:23.419364 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-fd8a98fa-246b-451d-8c36-70657a572a30 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9" status: 204 len: 0 microversion: 2.1 time: 0.112279 May 28 17:29:23.419964 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 287/563] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 17:29:23 2022] DELETE /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 17:29:23.428207 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6b5722fb-0b55-4e8c-9bf5-6dca340dad51 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:23.428839 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6b5722fb-0b55-4e8c-9bf5-6dca340dad51 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:23.434863 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6b5722fb-0b55-4e8c-9bf5-6dca340dad51 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:23.435313 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6b5722fb-0b55-4e8c-9bf5-6dca340dad51 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:23.436106 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6b5722fb-0b55-4e8c-9bf5-6dca340dad51 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:23.436543 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6b5722fb-0b55-4e8c-9bf5-6dca340dad51 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:23.569587 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-6b5722fb-0b55-4e8c-9bf5-6dca340dad51 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:23.576889 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6b5722fb-0b55-4e8c-9bf5-6dca340dad51 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9" status: 200 len: 1502 microversion: 2.1 time: 0.152608 May 28 17:29:23.577444 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 277/564] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:23 2022] GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:24.594450 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-fceb22cd-d21d-4a20-8b87-b97ad1bef391 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:24.595135 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-fceb22cd-d21d-4a20-8b87-b97ad1bef391 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:24.601674 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fceb22cd-d21d-4a20-8b87-b97ad1bef391 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:24.602060 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fceb22cd-d21d-4a20-8b87-b97ad1bef391 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:24.602833 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fceb22cd-d21d-4a20-8b87-b97ad1bef391 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:24.603285 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fceb22cd-d21d-4a20-8b87-b97ad1bef391 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:24.739135 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-fceb22cd-d21d-4a20-8b87-b97ad1bef391 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:24.746631 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-fceb22cd-d21d-4a20-8b87-b97ad1bef391 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9" status: 200 len: 1502 microversion: 2.1 time: 0.156334 May 28 17:29:24.747184 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 288/565] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:24 2022] GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:25.763132 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-bc56714b-97dd-4bf0-9b38-68844795f779 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:25.763767 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-bc56714b-97dd-4bf0-9b38-68844795f779 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:25.770642 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bc56714b-97dd-4bf0-9b38-68844795f779 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:25.771085 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bc56714b-97dd-4bf0-9b38-68844795f779 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:25.771870 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bc56714b-97dd-4bf0-9b38-68844795f779 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:25.772303 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bc56714b-97dd-4bf0-9b38-68844795f779 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:25.901762 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bc56714b-97dd-4bf0-9b38-68844795f779 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:25.909497 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-bc56714b-97dd-4bf0-9b38-68844795f779 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9" status: 200 len: 1502 microversion: 2.1 time: 0.149928 May 28 17:29:25.910055 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 278/566] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:25 2022] GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:26.457702 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-70f54b86-1035-489f-92d2-9ac5d584a5f4 req-44b887d6-7497-4b6c-a286-42d6e8cb62c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aeee30e-c713-4fbf-8264-6a47cb986bf9", "name": "network-vif-deleted", "tag": "0bf565cf-1c8d-411c-9424-951d8df39dbe"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:29:26.466249 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-70f54b86-1035-489f-92d2-9ac5d584a5f4 req-44b887d6-7497-4b6c-a286-42d6e8cb62c4 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:26.466695 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-70f54b86-1035-489f-92d2-9ac5d584a5f4 req-44b887d6-7497-4b6c-a286-42d6e8cb62c4 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:26.480603 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-70f54b86-1035-489f-92d2-9ac5d584a5f4 req-44b887d6-7497-4b6c-a286-42d6e8cb62c4 service nova] Creating event network-vif-deleted:0bf565cf-1c8d-411c-9424-951d8df39dbe for instance 8aeee30e-c713-4fbf-8264-6a47cb986bf9 on hv-cinder-84372 May 28 17:29:26.486221 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-70f54b86-1035-489f-92d2-9ac5d584a5f4 req-44b887d6-7497-4b6c-a286-42d6e8cb62c4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032017 May 28 17:29:26.486900 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 289/567] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:29:26.926153 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8bca8f90-bd03-48c7-b8f1-101365c78f30 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:26.926692 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8bca8f90-bd03-48c7-b8f1-101365c78f30 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:26.929122 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:29:26.934389 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8bca8f90-bd03-48c7-b8f1-101365c78f30 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:26.934868 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8bca8f90-bd03-48c7-b8f1-101365c78f30 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:26.935652 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8bca8f90-bd03-48c7-b8f1-101365c78f30 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:26.936092 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8bca8f90-bd03-48c7-b8f1-101365c78f30 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:26.968790 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8bca8f90-bd03-48c7-b8f1-101365c78f30 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:26.969237 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8bca8f90-bd03-48c7-b8f1-101365c78f30 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:26.969681 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-8bca8f90-bd03-48c7-b8f1-101365c78f30 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lazy-loading 'fault' on Instance uuid 8aeee30e-c713-4fbf-8264-6a47cb986bf9 {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 17:29:27.010221 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8bca8f90-bd03-48c7-b8f1-101365c78f30 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14273a09857f431bb7841b321b913c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9065845ed3d0457c9ab0889760958a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:27.017566 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8bca8f90-bd03-48c7-b8f1-101365c78f30 tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9" status: 200 len: 1303 microversion: 2.1 time: 0.095544 May 28 17:29:27.018892 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 279/568] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:26 2022] GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:27.369147 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1ea94f11-6866-4b46-9d83-0c2e98ae9439 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:29:27.375641 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1ea94f11-6866-4b46-9d83-0c2e98ae9439 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:27.376090 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1ea94f11-6866-4b46-9d83-0c2e98ae9439 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:27.435750 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1ea94f11-6866-4b46-9d83-0c2e98ae9439 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Going to try to stop instance {{(pid=117604) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 28 17:29:27.476452 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1ea94f11-6866-4b46-9d83-0c2e98ae9439 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "POST /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512/action" status: 202 len: 0 microversion: 2.1 time: 0.111421 May 28 17:29:27.477104 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 290/569] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 17:29:27 2022] POST /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 17:29:27.485224 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-bae0ea7c-98b0-4a84-b4c3-5a926c7b3a91 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:27.486050 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-bae0ea7c-98b0-4a84-b4c3-5a926c7b3a91 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:27.492708 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bae0ea7c-98b0-4a84-b4c3-5a926c7b3a91 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:27.493322 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bae0ea7c-98b0-4a84-b4c3-5a926c7b3a91 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:27.495579 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bae0ea7c-98b0-4a84-b4c3-5a926c7b3a91 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:27.496027 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bae0ea7c-98b0-4a84-b4c3-5a926c7b3a91 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:27.632918 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bae0ea7c-98b0-4a84-b4c3-5a926c7b3a91 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:27.640727 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-bae0ea7c-98b0-4a84-b4c3-5a926c7b3a91 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1722 microversion: 2.1 time: 0.159454 May 28 17:29:27.641316 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 280/570] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:27 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:28.036735 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1a70a650-f4c6-4161-ac92-546e6086900e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:28.037466 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1a70a650-f4c6-4161-ac92-546e6086900e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] [instance: 8aeee30e-c713-4fbf-8264-6a47cb986bf9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:28.043793 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1a70a650-f4c6-4161-ac92-546e6086900e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:28.044248 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1a70a650-f4c6-4161-ac92-546e6086900e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:28.045009 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1a70a650-f4c6-4161-ac92-546e6086900e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:28.045452 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1a70a650-f4c6-4161-ac92-546e6086900e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:28.061906 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-1a70a650-f4c6-4161-ac92-546e6086900e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] HTTP exception thrown: Instance 8aeee30e-c713-4fbf-8264-6a47cb986bf9 could not be found. May 28 17:29:28.063715 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1a70a650-f4c6-4161-ac92-546e6086900e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Request method failure captured: May 28 17:29:28.063715 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 HTTP/1.1 May 28 17:29:28.063715 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:29:28.063715 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:29:28.063715 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:29:28.063715 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 0 May 28 17:29:28.063715 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:29:28.063715 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:29:28.063715 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:29:28.063715 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:29:28.063715 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABikluUS_RWrzKqQJ6aEhlbJPnPoxRHLUbYW8e2vNpXzl--Ze9NIU8NkpWhZsAD3wvelK3QvNuf-nUXGmuxoT0eL7jJBm5AKlAJYloqCbE4cXj8l4ZEfo80wwGSxDVuvvf4VnpzhM_2KJPwVF1r376VhGqigdQPPwITdhANkE4hdF2PZ1U May 28 17:29:28.063715 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:29:28.063715 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:29:28.063715 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:29:28.063715 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:29:28.063715 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:29:28.063715 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:29:28.063715 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: 9065845ed3d0457c9ab0889760958a32 May 28 17:29:28.063715 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-VolumesActionsTest-997537412 May 28 17:29:28.063715 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:29:28.063715 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:29:28.065326 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9065845ed3d0457c9ab0889760958a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9065845ed3d0457c9ab0889760958a32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9065845ed3d0457c9ab0889760958a32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9065845ed3d0457c9ab0889760958a32", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:29:28.065326 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-VolumesActionsTest-997537412 May 28 17:29:28.065326 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 9065845ed3d0457c9ab0889760958a32 May 28 17:29:28.065326 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-VolumesActionsTest-997537412 May 28 17:29:28.065326 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-VolumesActionsTest-997537412-project May 28 17:29:28.065326 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:29:28.065326 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:29:28.065326 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: 14273a09857f431bb7841b321b913c00 May 28 17:29:28.065326 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-VolumesActionsTest-997537412-project May 28 17:29:28.065326 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: > May 28 17:29:28.065326 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Instance 8aeee30e-c713-4fbf-8264-6a47cb986bf9 could not be found. May 28 17:29:28.065326 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'id': '8aeee30e-c713-4fbf-8264-6a47cb986bf9'} May 28 17:29:28.066161 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:29:28.066161 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:29:28.066161 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:29:28.066161 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:29:28.066161 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:29:28.066161 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:29:28.066161 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:29:28.066161 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:29:28.066161 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:29:28.066161 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:29:28.066161 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8aeee30e-c713-4fbf-8264-6a47cb986bf9 could not be found. May 28 17:29:28.066161 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:29:28.066161 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:29:28.066161 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:29:28.066161 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:29:28.066161 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:29:28.066161 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:29:28.066161 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:29:28.066161 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:29:28.066161 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:29:28.067618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:29:28.067618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:29:28.067618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:29:28.067618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:29:28.067618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:29:28.067618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:29:28.067618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:29:28.067618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8aeee30e-c713-4fbf-8264-6a47cb986bf9 could not be found. May 28 17:29:28.067618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:29:28.067618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:29:28.067618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:29:28.067618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:29:28.067618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:29:28.067618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:29:28.067618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:29:28.067618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:29:28.067618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8aeee30e-c713-4fbf-8264-6a47cb986bf9 could not be found. May 28 17:29:28.067618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:29:28.068904 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1a70a650-f4c6-4161-ac92-546e6086900e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] Returning 404 to user: Instance 8aeee30e-c713-4fbf-8264-6a47cb986bf9 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:29:28.068904 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1a70a650-f4c6-4161-ac92-546e6086900e tempest-VolumesActionsTest-997537412 tempest-VolumesActionsTest-997537412-project] 10.222.0.33 "GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9" status: 404 len: 111 microversion: 2.1 time: 0.033312 May 28 17:29:28.068904 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 291/571] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:28 2022] GET /compute/v2.1/servers/8aeee30e-c713-4fbf-8264-6a47cb986bf9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:29:28.657742 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-dfaa72ce-8951-40cc-a78b-6455b1e78a33 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:28.658361 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-dfaa72ce-8951-40cc-a78b-6455b1e78a33 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:28.665009 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dfaa72ce-8951-40cc-a78b-6455b1e78a33 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:28.665460 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dfaa72ce-8951-40cc-a78b-6455b1e78a33 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:28.666223 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dfaa72ce-8951-40cc-a78b-6455b1e78a33 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:28.666664 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dfaa72ce-8951-40cc-a78b-6455b1e78a33 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:28.820457 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-dfaa72ce-8951-40cc-a78b-6455b1e78a33 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:28.828574 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-dfaa72ce-8951-40cc-a78b-6455b1e78a33 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1722 microversion: 2.1 time: 0.174640 May 28 17:29:28.829179 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 281/572] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:28 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:29.845940 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ce05cb41-f984-4ac3-8814-080321e080b7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:29.847197 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ce05cb41-f984-4ac3-8814-080321e080b7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:29.853731 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ce05cb41-f984-4ac3-8814-080321e080b7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:29.854179 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ce05cb41-f984-4ac3-8814-080321e080b7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:29.854936 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ce05cb41-f984-4ac3-8814-080321e080b7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:29.855402 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ce05cb41-f984-4ac3-8814-080321e080b7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:29.983833 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ce05cb41-f984-4ac3-8814-080321e080b7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:29.991973 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ce05cb41-f984-4ac3-8814-080321e080b7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1722 microversion: 2.1 time: 0.149924 May 28 17:29:29.992528 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 292/573] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:29 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:31.009145 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c9b671d6-3d61-47a3-9033-4e85b4c70e08 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:31.009762 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c9b671d6-3d61-47a3-9033-4e85b4c70e08 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:31.016217 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c9b671d6-3d61-47a3-9033-4e85b4c70e08 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:31.016670 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c9b671d6-3d61-47a3-9033-4e85b4c70e08 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:31.017431 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c9b671d6-3d61-47a3-9033-4e85b4c70e08 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:31.018391 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c9b671d6-3d61-47a3-9033-4e85b4c70e08 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:31.021106 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=100 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:29:31.147847 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c9b671d6-3d61-47a3-9033-4e85b4c70e08 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:31.156048 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c9b671d6-3d61-47a3-9033-4e85b4c70e08 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1722 microversion: 2.1 time: 0.150671 May 28 17:29:31.156613 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 282/574] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:31 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:32.174076 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e1713ee8-6e20-4353-b52e-73f3b5974d01 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:32.175391 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e1713ee8-6e20-4353-b52e-73f3b5974d01 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:32.177809 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:29:32.183662 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e1713ee8-6e20-4353-b52e-73f3b5974d01 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:32.184110 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e1713ee8-6e20-4353-b52e-73f3b5974d01 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:32.184926 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e1713ee8-6e20-4353-b52e-73f3b5974d01 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:32.185383 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e1713ee8-6e20-4353-b52e-73f3b5974d01 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:32.316616 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e1713ee8-6e20-4353-b52e-73f3b5974d01 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:32.324771 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e1713ee8-6e20-4353-b52e-73f3b5974d01 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1722 microversion: 2.1 time: 0.154410 May 28 17:29:32.325326 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 293/575] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:32 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:33.341192 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-59aff397-0bd1-4d1e-baa9-05b055e8ac65 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:33.341744 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-59aff397-0bd1-4d1e-baa9-05b055e8ac65 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:33.348401 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-59aff397-0bd1-4d1e-baa9-05b055e8ac65 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:33.348854 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-59aff397-0bd1-4d1e-baa9-05b055e8ac65 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:33.349610 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-59aff397-0bd1-4d1e-baa9-05b055e8ac65 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:33.350048 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-59aff397-0bd1-4d1e-baa9-05b055e8ac65 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:33.483611 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-59aff397-0bd1-4d1e-baa9-05b055e8ac65 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:33.492503 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-59aff397-0bd1-4d1e-baa9-05b055e8ac65 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1722 microversion: 2.1 time: 0.155246 May 28 17:29:33.493180 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 283/576] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:33 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:34.510087 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-635c7d3a-e46c-4a67-86df-3c714806f0ab tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:34.511240 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-635c7d3a-e46c-4a67-86df-3c714806f0ab tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:34.518361 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-635c7d3a-e46c-4a67-86df-3c714806f0ab tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:34.519513 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-635c7d3a-e46c-4a67-86df-3c714806f0ab tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:34.520355 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-635c7d3a-e46c-4a67-86df-3c714806f0ab tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:34.520816 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-635c7d3a-e46c-4a67-86df-3c714806f0ab tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:34.666989 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-635c7d3a-e46c-4a67-86df-3c714806f0ab tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:34.674983 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-635c7d3a-e46c-4a67-86df-3c714806f0ab tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1722 microversion: 2.1 time: 0.168775 May 28 17:29:34.675670 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 294/577] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:34 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:35.692725 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4dee7f99-4f0e-48b8-90d5-3abbd611694b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:35.693462 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4dee7f99-4f0e-48b8-90d5-3abbd611694b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:35.700042 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4dee7f99-4f0e-48b8-90d5-3abbd611694b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:35.700489 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4dee7f99-4f0e-48b8-90d5-3abbd611694b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:35.701259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4dee7f99-4f0e-48b8-90d5-3abbd611694b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:35.701691 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4dee7f99-4f0e-48b8-90d5-3abbd611694b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:35.913580 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4dee7f99-4f0e-48b8-90d5-3abbd611694b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:35.921423 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4dee7f99-4f0e-48b8-90d5-3abbd611694b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1722 microversion: 2.1 time: 0.233506 May 28 17:29:35.922081 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 284/578] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:35 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:36.938207 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5e609aa5-19dd-4a33-8169-d809c6f5fcec tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:36.939463 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5e609aa5-19dd-4a33-8169-d809c6f5fcec tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:36.946640 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5e609aa5-19dd-4a33-8169-d809c6f5fcec tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:36.947091 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5e609aa5-19dd-4a33-8169-d809c6f5fcec tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:36.948118 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5e609aa5-19dd-4a33-8169-d809c6f5fcec tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:36.948727 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5e609aa5-19dd-4a33-8169-d809c6f5fcec tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:37.141083 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5e609aa5-19dd-4a33-8169-d809c6f5fcec tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:37.150914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5e609aa5-19dd-4a33-8169-d809c6f5fcec tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1722 microversion: 2.1 time: 0.216595 May 28 17:29:37.151647 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 295/579] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:36 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:38.172015 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-bfde645c-d587-4579-b857-28fcdc0806a1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:38.177461 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-bfde645c-d587-4579-b857-28fcdc0806a1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:38.194423 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bfde645c-d587-4579-b857-28fcdc0806a1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:38.195868 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bfde645c-d587-4579-b857-28fcdc0806a1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:38.196841 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bfde645c-d587-4579-b857-28fcdc0806a1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:38.198818 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bfde645c-d587-4579-b857-28fcdc0806a1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:38.393327 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bfde645c-d587-4579-b857-28fcdc0806a1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:38.403424 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-bfde645c-d587-4579-b857-28fcdc0806a1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1722 microversion: 2.1 time: 0.235699 May 28 17:29:38.404232 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 285/580] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:38 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:39.425827 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d654afdd-d2eb-4a31-ba41-c13caf109d5b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:39.426458 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d654afdd-d2eb-4a31-ba41-c13caf109d5b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:39.434765 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d654afdd-d2eb-4a31-ba41-c13caf109d5b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:39.435628 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d654afdd-d2eb-4a31-ba41-c13caf109d5b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:39.436909 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d654afdd-d2eb-4a31-ba41-c13caf109d5b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:39.437754 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d654afdd-d2eb-4a31-ba41-c13caf109d5b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:39.598861 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d654afdd-d2eb-4a31-ba41-c13caf109d5b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:39.607939 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d654afdd-d2eb-4a31-ba41-c13caf109d5b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1722 microversion: 2.1 time: 0.187009 May 28 17:29:39.609340 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 296/581] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:39 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:40.632941 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b36adc03-baee-4ee9-94be-7c4b8f66de96 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:40.634058 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-b36adc03-baee-4ee9-94be-7c4b8f66de96 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:40.645190 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b36adc03-baee-4ee9-94be-7c4b8f66de96 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:40.646200 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b36adc03-baee-4ee9-94be-7c4b8f66de96 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:40.647363 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b36adc03-baee-4ee9-94be-7c4b8f66de96 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:40.648619 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b36adc03-baee-4ee9-94be-7c4b8f66de96 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:40.817033 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b36adc03-baee-4ee9-94be-7c4b8f66de96 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:40.828410 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b36adc03-baee-4ee9-94be-7c4b8f66de96 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1722 microversion: 2.1 time: 0.203291 May 28 17:29:40.829208 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 286/582] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:40 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:41.852085 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-412d6370-4c1d-46cc-8c91-c436cc0076ce tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:41.852962 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-412d6370-4c1d-46cc-8c91-c436cc0076ce tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:41.859180 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-412d6370-4c1d-46cc-8c91-c436cc0076ce tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:41.859600 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-412d6370-4c1d-46cc-8c91-c436cc0076ce tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:41.860371 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-412d6370-4c1d-46cc-8c91-c436cc0076ce tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:41.863998 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-412d6370-4c1d-46cc-8c91-c436cc0076ce tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:42.021583 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-412d6370-4c1d-46cc-8c91-c436cc0076ce tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:42.029910 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-412d6370-4c1d-46cc-8c91-c436cc0076ce tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1722 microversion: 2.1 time: 0.183045 May 28 17:29:42.040197 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 297/583] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:41 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:43.047781 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-95d131ce-c7c4-49c5-9cb9-a7dc7f009ea7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:43.048396 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-95d131ce-c7c4-49c5-9cb9-a7dc7f009ea7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:43.056290 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-95d131ce-c7c4-49c5-9cb9-a7dc7f009ea7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:43.056736 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-95d131ce-c7c4-49c5-9cb9-a7dc7f009ea7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:43.057681 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-95d131ce-c7c4-49c5-9cb9-a7dc7f009ea7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:43.058275 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-95d131ce-c7c4-49c5-9cb9-a7dc7f009ea7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:43.199169 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-95d131ce-c7c4-49c5-9cb9-a7dc7f009ea7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:43.208518 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-95d131ce-c7c4-49c5-9cb9-a7dc7f009ea7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1722 microversion: 2.1 time: 0.164619 May 28 17:29:43.219719 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 287/584] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:43 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:44.230580 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-504723f5-6e7e-4cee-a9d8-61e833da86f4 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:44.231302 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-504723f5-6e7e-4cee-a9d8-61e833da86f4 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:44.237926 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-504723f5-6e7e-4cee-a9d8-61e833da86f4 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:44.238355 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-504723f5-6e7e-4cee-a9d8-61e833da86f4 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:44.239111 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-504723f5-6e7e-4cee-a9d8-61e833da86f4 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:44.239613 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-504723f5-6e7e-4cee-a9d8-61e833da86f4 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:44.392157 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-504723f5-6e7e-4cee-a9d8-61e833da86f4 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:44.403155 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-504723f5-6e7e-4cee-a9d8-61e833da86f4 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1722 microversion: 2.1 time: 0.176354 May 28 17:29:44.414266 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 298/585] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:44 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:45.421180 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3082c122-a5ee-4949-bb4b-57107f690372 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:45.421798 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3082c122-a5ee-4949-bb4b-57107f690372 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:45.430646 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3082c122-a5ee-4949-bb4b-57107f690372 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:45.431184 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3082c122-a5ee-4949-bb4b-57107f690372 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:45.432042 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3082c122-a5ee-4949-bb4b-57107f690372 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:45.432543 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3082c122-a5ee-4949-bb4b-57107f690372 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:45.578524 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3082c122-a5ee-4949-bb4b-57107f690372 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:45.587742 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3082c122-a5ee-4949-bb4b-57107f690372 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1722 microversion: 2.1 time: 0.170266 May 28 17:29:45.593878 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 288/586] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:45 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:46.605974 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a951b8c1-0879-41c0-ad56-bd99a05e5de6 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:46.606705 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a951b8c1-0879-41c0-ad56-bd99a05e5de6 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:46.614443 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a951b8c1-0879-41c0-ad56-bd99a05e5de6 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:46.614896 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a951b8c1-0879-41c0-ad56-bd99a05e5de6 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:46.615714 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a951b8c1-0879-41c0-ad56-bd99a05e5de6 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:46.616339 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a951b8c1-0879-41c0-ad56-bd99a05e5de6 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:46.761564 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a951b8c1-0879-41c0-ad56-bd99a05e5de6 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:46.770642 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a951b8c1-0879-41c0-ad56-bd99a05e5de6 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1722 microversion: 2.1 time: 0.168570 May 28 17:29:46.771330 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 299/587] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:46 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:47.787635 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-870f15c1-7101-4b18-ac07-cb7deaa57eed tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:47.788917 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-870f15c1-7101-4b18-ac07-cb7deaa57eed tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:47.795375 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-870f15c1-7101-4b18-ac07-cb7deaa57eed tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:47.802460 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-870f15c1-7101-4b18-ac07-cb7deaa57eed tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:47.803605 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-870f15c1-7101-4b18-ac07-cb7deaa57eed tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:47.804238 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-870f15c1-7101-4b18-ac07-cb7deaa57eed tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:47.943096 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-870f15c1-7101-4b18-ac07-cb7deaa57eed tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:47.952032 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-870f15c1-7101-4b18-ac07-cb7deaa57eed tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1722 microversion: 2.1 time: 0.168518 May 28 17:29:47.962049 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 289/588] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:47 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:48.969430 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-cca59ecd-ad17-4082-959b-69beb52cb15d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:48.970217 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-cca59ecd-ad17-4082-959b-69beb52cb15d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:48.977803 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cca59ecd-ad17-4082-959b-69beb52cb15d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:48.978553 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cca59ecd-ad17-4082-959b-69beb52cb15d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:48.979449 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cca59ecd-ad17-4082-959b-69beb52cb15d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:48.980095 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cca59ecd-ad17-4082-959b-69beb52cb15d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:49.121672 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-cca59ecd-ad17-4082-959b-69beb52cb15d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:49.130548 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-cca59ecd-ad17-4082-959b-69beb52cb15d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1722 microversion: 2.1 time: 0.165142 May 28 17:29:49.131752 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 300/589] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:48 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:50.148498 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0f64775f-4942-4937-9ed0-16d227579fd3 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:50.149898 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0f64775f-4942-4937-9ed0-16d227579fd3 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:50.156350 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0f64775f-4942-4937-9ed0-16d227579fd3 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:50.156806 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0f64775f-4942-4937-9ed0-16d227579fd3 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:50.157583 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0f64775f-4942-4937-9ed0-16d227579fd3 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:50.158030 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0f64775f-4942-4937-9ed0-16d227579fd3 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:50.307446 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0f64775f-4942-4937-9ed0-16d227579fd3 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:50.316851 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0f64775f-4942-4937-9ed0-16d227579fd3 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1722 microversion: 2.1 time: 0.171980 May 28 17:29:50.317747 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 290/590] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:50 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:51.334983 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5dbd5781-8523-42c4-bdd0-44075fc11d54 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:51.335571 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5dbd5781-8523-42c4-bdd0-44075fc11d54 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:51.341963 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5dbd5781-8523-42c4-bdd0-44075fc11d54 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:51.342413 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5dbd5781-8523-42c4-bdd0-44075fc11d54 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:51.343180 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5dbd5781-8523-42c4-bdd0-44075fc11d54 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:51.343640 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5dbd5781-8523-42c4-bdd0-44075fc11d54 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:51.471039 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5dbd5781-8523-42c4-bdd0-44075fc11d54 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:51.479062 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5dbd5781-8523-42c4-bdd0-44075fc11d54 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1722 microversion: 2.1 time: 0.148776 May 28 17:29:51.479650 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 301/591] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:51 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:52.496579 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b68c4f06-bd81-4e6b-b023-7b314bccbef0 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:52.497198 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-b68c4f06-bd81-4e6b-b023-7b314bccbef0 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:52.504690 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b68c4f06-bd81-4e6b-b023-7b314bccbef0 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:52.505171 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b68c4f06-bd81-4e6b-b023-7b314bccbef0 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:52.505940 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b68c4f06-bd81-4e6b-b023-7b314bccbef0 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:52.506384 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b68c4f06-bd81-4e6b-b023-7b314bccbef0 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:52.634903 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b68c4f06-bd81-4e6b-b023-7b314bccbef0 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:52.642775 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b68c4f06-bd81-4e6b-b023-7b314bccbef0 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1722 microversion: 2.1 time: 0.150135 May 28 17:29:52.643383 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 291/592] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:52 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:53.218508 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ca41bf4d-ed73-4893-a1b9-63f970b59269 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:53.219085 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ca41bf4d-ed73-4893-a1b9-63f970b59269 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: a3819481-ecb7-47a2-86b2-78c6c1c40d61] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:53.225947 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ca41bf4d-ed73-4893-a1b9-63f970b59269 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:53.226405 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ca41bf4d-ed73-4893-a1b9-63f970b59269 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:53.227178 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ca41bf4d-ed73-4893-a1b9-63f970b59269 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:53.227651 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ca41bf4d-ed73-4893-a1b9-63f970b59269 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:53.311981 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-ca41bf4d-ed73-4893-a1b9-63f970b59269 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lazy-loading 'services' on Instance uuid a3819481-ecb7-47a2-86b2-78c6c1c40d61 {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 17:29:53.386258 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ca41bf4d-ed73-4893-a1b9-63f970b59269 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61/os-volume_attachments/fe46da06-465c-4a3c-8408-475cd1153a58" status: 202 len: 0 microversion: 2.1 time: 0.171701 May 28 17:29:53.386993 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 302/593] 10.222.0.33 () {58 vars in 1415 bytes} [Sat May 28 17:29:53 2022] DELETE /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61/os-volume_attachments/fe46da06-465c-4a3c-8408-475cd1153a58 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 17:29:53.660109 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-71458174-75d5-46c0-a13d-76a94faae322 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:53.660833 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-71458174-75d5-46c0-a13d-76a94faae322 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:53.667284 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-71458174-75d5-46c0-a13d-76a94faae322 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:53.667884 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-71458174-75d5-46c0-a13d-76a94faae322 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:53.668657 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-71458174-75d5-46c0-a13d-76a94faae322 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:53.669102 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-71458174-75d5-46c0-a13d-76a94faae322 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:53.806256 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-71458174-75d5-46c0-a13d-76a94faae322 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:53.814315 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-71458174-75d5-46c0-a13d-76a94faae322 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1722 microversion: 2.1 time: 0.158324 May 28 17:29:53.814976 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 292/594] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:53 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:54.508982 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ccbf524c-cb1c-4418-821a-6b1b2e43d62c tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:54.508982 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ccbf524c-cb1c-4418-821a-6b1b2e43d62c tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: a3819481-ecb7-47a2-86b2-78c6c1c40d61] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:54.513219 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ccbf524c-cb1c-4418-821a-6b1b2e43d62c tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:54.513682 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ccbf524c-cb1c-4418-821a-6b1b2e43d62c tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:54.514460 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ccbf524c-cb1c-4418-821a-6b1b2e43d62c tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:54.515088 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ccbf524c-cb1c-4418-821a-6b1b2e43d62c tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:54.520525 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:29:54.563676 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ccbf524c-cb1c-4418-821a-6b1b2e43d62c tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: a3819481-ecb7-47a2-86b2-78c6c1c40d61] Going to try to terminate instance {{(pid=117604) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 17:29:54.653462 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ccbf524c-cb1c-4418-821a-6b1b2e43d62c tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61" status: 204 len: 0 microversion: 2.1 time: 0.152742 May 28 17:29:54.654311 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 303/595] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 17:29:54 2022] DELETE /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 17:29:54.666168 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a4fa9f37-6143-46c8-b8c4-f26e6a0630e8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:54.666793 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a4fa9f37-6143-46c8-b8c4-f26e6a0630e8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: a3819481-ecb7-47a2-86b2-78c6c1c40d61] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:54.673410 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a4fa9f37-6143-46c8-b8c4-f26e6a0630e8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:54.673873 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a4fa9f37-6143-46c8-b8c4-f26e6a0630e8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:54.674678 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a4fa9f37-6143-46c8-b8c4-f26e6a0630e8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:54.675150 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a4fa9f37-6143-46c8-b8c4-f26e6a0630e8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:54.812383 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a4fa9f37-6143-46c8-b8c4-f26e6a0630e8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:54.820098 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a4fa9f37-6143-46c8-b8c4-f26e6a0630e8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61" status: 200 len: 1515 microversion: 2.1 time: 0.161258 May 28 17:29:54.820898 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 293/596] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:54 2022] GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:54.832863 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6d520c81-585c-41c6-a0d9-0d98b4bfefa4 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:54.833644 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6d520c81-585c-41c6-a0d9-0d98b4bfefa4 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:54.840347 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6d520c81-585c-41c6-a0d9-0d98b4bfefa4 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:54.840805 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6d520c81-585c-41c6-a0d9-0d98b4bfefa4 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:54.841575 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6d520c81-585c-41c6-a0d9-0d98b4bfefa4 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:54.842017 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6d520c81-585c-41c6-a0d9-0d98b4bfefa4 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:54.984487 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6d520c81-585c-41c6-a0d9-0d98b4bfefa4 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:54.994026 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6d520c81-585c-41c6-a0d9-0d98b4bfefa4 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1722 microversion: 2.1 time: 0.165604 May 28 17:29:54.994594 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 304/597] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:54 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:55.837925 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-35a85009-9e5f-472c-b078-d3670d8d6346 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:55.838540 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-35a85009-9e5f-472c-b078-d3670d8d6346 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: a3819481-ecb7-47a2-86b2-78c6c1c40d61] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:55.845043 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-35a85009-9e5f-472c-b078-d3670d8d6346 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:55.845493 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-35a85009-9e5f-472c-b078-d3670d8d6346 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:55.846248 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-35a85009-9e5f-472c-b078-d3670d8d6346 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:55.846685 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-35a85009-9e5f-472c-b078-d3670d8d6346 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:55.975010 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-35a85009-9e5f-472c-b078-d3670d8d6346 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:55.982382 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-35a85009-9e5f-472c-b078-d3670d8d6346 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61" status: 200 len: 1515 microversion: 2.1 time: 0.148300 May 28 17:29:55.982971 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 294/598] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:55 2022] GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:56.011436 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6c85ac2c-86cd-48ca-998e-843ee009dd4b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:56.012056 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6c85ac2c-86cd-48ca-998e-843ee009dd4b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:56.018522 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6c85ac2c-86cd-48ca-998e-843ee009dd4b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:56.018977 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6c85ac2c-86cd-48ca-998e-843ee009dd4b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:56.019777 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6c85ac2c-86cd-48ca-998e-843ee009dd4b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:56.020844 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6c85ac2c-86cd-48ca-998e-843ee009dd4b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:56.145986 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6c85ac2c-86cd-48ca-998e-843ee009dd4b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:56.153942 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6c85ac2c-86cd-48ca-998e-843ee009dd4b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1722 microversion: 2.1 time: 0.146303 May 28 17:29:56.154508 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 305/599] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:56 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:56.999857 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1a536ea5-96e6-4e4d-a7b2-72e1396e8881 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:57.000687 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1a536ea5-96e6-4e4d-a7b2-72e1396e8881 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: a3819481-ecb7-47a2-86b2-78c6c1c40d61] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:57.002932 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=34 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:29:57.008463 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1a536ea5-96e6-4e4d-a7b2-72e1396e8881 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:57.008917 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1a536ea5-96e6-4e4d-a7b2-72e1396e8881 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:57.009675 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1a536ea5-96e6-4e4d-a7b2-72e1396e8881 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:57.010113 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1a536ea5-96e6-4e4d-a7b2-72e1396e8881 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:57.140426 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1a536ea5-96e6-4e4d-a7b2-72e1396e8881 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:57.154101 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1a536ea5-96e6-4e4d-a7b2-72e1396e8881 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61" status: 200 len: 1515 microversion: 2.1 time: 0.156602 May 28 17:29:57.154686 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 295/600] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:56 2022] GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:57.171145 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c06039b8-385a-48ed-b5a3-ea16598cd4fa tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:57.171797 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c06039b8-385a-48ed-b5a3-ea16598cd4fa tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:57.179239 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c06039b8-385a-48ed-b5a3-ea16598cd4fa tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:57.179742 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c06039b8-385a-48ed-b5a3-ea16598cd4fa tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:57.180494 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c06039b8-385a-48ed-b5a3-ea16598cd4fa tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:57.180932 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c06039b8-385a-48ed-b5a3-ea16598cd4fa tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:57.310397 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c06039b8-385a-48ed-b5a3-ea16598cd4fa tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:57.318956 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c06039b8-385a-48ed-b5a3-ea16598cd4fa tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1699 microversion: 2.1 time: 0.151639 May 28 17:29:57.319535 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 306/601] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:57 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1699 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:57.335535 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-684516e5-f541-4f18-8518-25d81200029e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:29:57.341513 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-684516e5-f541-4f18-8518-25d81200029e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:57.341975 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-684516e5-f541-4f18-8518-25d81200029e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:57.401500 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-684516e5-f541-4f18-8518-25d81200029e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Going to try to start instance {{(pid=117605) start /opt/stack/nova/nova/compute/api.py:2730}} May 28 17:29:57.442313 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-684516e5-f541-4f18-8518-25d81200029e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "POST /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512/action" status: 202 len: 0 microversion: 2.1 time: 0.110600 May 28 17:29:57.443215 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 296/602] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 17:29:57 2022] POST /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 17:29:57.451139 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a380c818-d5aa-447b-ada8-51fdca29f85e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:57.451892 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a380c818-d5aa-447b-ada8-51fdca29f85e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:57.458727 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a380c818-d5aa-447b-ada8-51fdca29f85e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:57.459175 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a380c818-d5aa-447b-ada8-51fdca29f85e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:57.459973 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a380c818-d5aa-447b-ada8-51fdca29f85e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:57.460411 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a380c818-d5aa-447b-ada8-51fdca29f85e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:57.587870 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a380c818-d5aa-447b-ada8-51fdca29f85e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:57.595889 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a380c818-d5aa-447b-ada8-51fdca29f85e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1708 microversion: 2.1 time: 0.148534 May 28 17:29:57.596461 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 307/603] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:57 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1708 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:58.172835 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-92dd4a9f-32a6-4f63-aa71-8b6e3a0721c8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:58.173540 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-92dd4a9f-32a6-4f63-aa71-8b6e3a0721c8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: a3819481-ecb7-47a2-86b2-78c6c1c40d61] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:58.180356 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-92dd4a9f-32a6-4f63-aa71-8b6e3a0721c8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:58.180820 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-92dd4a9f-32a6-4f63-aa71-8b6e3a0721c8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:58.181583 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-92dd4a9f-32a6-4f63-aa71-8b6e3a0721c8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:58.182028 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-92dd4a9f-32a6-4f63-aa71-8b6e3a0721c8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:58.309607 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-92dd4a9f-32a6-4f63-aa71-8b6e3a0721c8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:58.311909 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:29:58.318562 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-92dd4a9f-32a6-4f63-aa71-8b6e3a0721c8 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61" status: 200 len: 1515 microversion: 2.1 time: 0.150322 May 28 17:29:58.319102 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 297/604] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:58 2022] GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:58.613184 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d33b3446-d62a-4171-acdd-9adbe71a4fe3 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:58.613801 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d33b3446-d62a-4171-acdd-9adbe71a4fe3 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:58.620227 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d33b3446-d62a-4171-acdd-9adbe71a4fe3 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:58.620679 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d33b3446-d62a-4171-acdd-9adbe71a4fe3 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:58.621441 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d33b3446-d62a-4171-acdd-9adbe71a4fe3 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:58.621877 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d33b3446-d62a-4171-acdd-9adbe71a4fe3 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:58.750005 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d33b3446-d62a-4171-acdd-9adbe71a4fe3 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:58.758701 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d33b3446-d62a-4171-acdd-9adbe71a4fe3 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1708 microversion: 2.1 time: 0.149363 May 28 17:29:58.759380 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 308/605] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:58 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1708 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:59.335511 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7179e996-d012-4d49-9836-6d26a653ce8e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:59.336126 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7179e996-d012-4d49-9836-6d26a653ce8e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: a3819481-ecb7-47a2-86b2-78c6c1c40d61] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:59.344500 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7179e996-d012-4d49-9836-6d26a653ce8e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:59.344952 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7179e996-d012-4d49-9836-6d26a653ce8e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:59.345728 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7179e996-d012-4d49-9836-6d26a653ce8e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:59.346191 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7179e996-d012-4d49-9836-6d26a653ce8e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:59.498264 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7179e996-d012-4d49-9836-6d26a653ce8e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:59.507883 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7179e996-d012-4d49-9836-6d26a653ce8e tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61" status: 200 len: 1515 microversion: 2.1 time: 0.175606 May 28 17:29:59.508685 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 298/606] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:59 2022] GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61 => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:29:59.776082 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-40b19c21-93e3-4f43-bae8-1e1066f78714 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:29:59.776694 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-40b19c21-93e3-4f43-bae8-1e1066f78714 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:29:59.783203 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-40b19c21-93e3-4f43-bae8-1e1066f78714 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:59.783684 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-40b19c21-93e3-4f43-bae8-1e1066f78714 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:59.784444 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-40b19c21-93e3-4f43-bae8-1e1066f78714 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:29:59.784878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-40b19c21-93e3-4f43-bae8-1e1066f78714 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:29:59.912980 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-40b19c21-93e3-4f43-bae8-1e1066f78714 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:29:59.921004 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-40b19c21-93e3-4f43-bae8-1e1066f78714 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1708 microversion: 2.1 time: 0.148847 May 28 17:29:59.921573 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 309/607] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:29:59 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1708 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:30:00.525698 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-08c5f463-0c2e-49b3-a26e-3703d5cdec15 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:00.526310 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-08c5f463-0c2e-49b3-a26e-3703d5cdec15 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: a3819481-ecb7-47a2-86b2-78c6c1c40d61] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:00.532773 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-08c5f463-0c2e-49b3-a26e-3703d5cdec15 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:00.533224 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-08c5f463-0c2e-49b3-a26e-3703d5cdec15 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:00.533981 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-08c5f463-0c2e-49b3-a26e-3703d5cdec15 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:00.534418 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-08c5f463-0c2e-49b3-a26e-3703d5cdec15 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:00.668226 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-08c5f463-0c2e-49b3-a26e-3703d5cdec15 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:00.675677 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-08c5f463-0c2e-49b3-a26e-3703d5cdec15 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61" status: 200 len: 1515 microversion: 2.1 time: 0.154437 May 28 17:30:00.676248 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 299/608] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:30:00 2022] GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:30:00.938150 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-05990df6-863c-463c-863e-2c8bbf9c3593 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:00.938759 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-05990df6-863c-463c-863e-2c8bbf9c3593 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:00.945903 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-05990df6-863c-463c-863e-2c8bbf9c3593 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:00.946379 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-05990df6-863c-463c-863e-2c8bbf9c3593 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:00.947135 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-05990df6-863c-463c-863e-2c8bbf9c3593 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:00.947608 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-05990df6-863c-463c-863e-2c8bbf9c3593 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:01.078265 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-05990df6-863c-463c-863e-2c8bbf9c3593 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:01.086459 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-05990df6-863c-463c-863e-2c8bbf9c3593 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1708 microversion: 2.1 time: 0.152181 May 28 17:30:01.087022 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 310/609] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:30:00 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1708 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:30:01.693643 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6320b932-7704-47aa-8010-1ee841a77466 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:01.695134 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6320b932-7704-47aa-8010-1ee841a77466 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: a3819481-ecb7-47a2-86b2-78c6c1c40d61] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:01.702060 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6320b932-7704-47aa-8010-1ee841a77466 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:01.702816 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6320b932-7704-47aa-8010-1ee841a77466 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:01.703863 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6320b932-7704-47aa-8010-1ee841a77466 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:01.704517 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6320b932-7704-47aa-8010-1ee841a77466 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:01.892855 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-6320b932-7704-47aa-8010-1ee841a77466 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a6d8ab7cc04e14b8f148412974e995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6efc6e9dad4ab1b9c40ab78d5a360d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:01.901169 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6320b932-7704-47aa-8010-1ee841a77466 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61" status: 200 len: 1515 microversion: 2.1 time: 0.211837 May 28 17:30:01.901751 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 300/610] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:30:01 2022] GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61 => generated 1515 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:30:02.011741 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-a4c1f672-4ed6-4256-8780-dacec5f9bf43 req-241ddc0c-fa67-40f7-9cc4-ec4bfeb5b059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3819481-ecb7-47a2-86b2-78c6c1c40d61", "name": "network-vif-deleted", "tag": "e2176952-8c79-446f-97c9-b6c6820083b3"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:30:02.020993 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-a4c1f672-4ed6-4256-8780-dacec5f9bf43 req-241ddc0c-fa67-40f7-9cc4-ec4bfeb5b059 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:02.021544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-a4c1f672-4ed6-4256-8780-dacec5f9bf43 req-241ddc0c-fa67-40f7-9cc4-ec4bfeb5b059 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:02.033015 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-a4c1f672-4ed6-4256-8780-dacec5f9bf43 req-241ddc0c-fa67-40f7-9cc4-ec4bfeb5b059 service nova] Creating event network-vif-deleted:e2176952-8c79-446f-97c9-b6c6820083b3 for instance a3819481-ecb7-47a2-86b2-78c6c1c40d61 on hv-cinder-84372 May 28 17:30:02.038346 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-a4c1f672-4ed6-4256-8780-dacec5f9bf43 req-241ddc0c-fa67-40f7-9cc4-ec4bfeb5b059 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030758 May 28 17:30:02.042081 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 311/611] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:30:02.103926 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6efb9cf4-dbb6-43a8-8b47-930a3552c045 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:02.104585 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6efb9cf4-dbb6-43a8-8b47-930a3552c045 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:02.111501 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6efb9cf4-dbb6-43a8-8b47-930a3552c045 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:02.112235 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6efb9cf4-dbb6-43a8-8b47-930a3552c045 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:02.113069 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6efb9cf4-dbb6-43a8-8b47-930a3552c045 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:02.113576 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6efb9cf4-dbb6-43a8-8b47-930a3552c045 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:02.247609 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-6efb9cf4-dbb6-43a8-8b47-930a3552c045 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:02.255862 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6efb9cf4-dbb6-43a8-8b47-930a3552c045 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1708 microversion: 2.1 time: 0.156251 May 28 17:30:02.256412 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 301/612] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:30:02 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1708 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:30:02.919272 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d2cb62da-d525-4fd5-bd21-35b659525db9 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:02.919903 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d2cb62da-d525-4fd5-bd21-35b659525db9 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] [instance: a3819481-ecb7-47a2-86b2-78c6c1c40d61] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:02.921842 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:30:02.927275 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d2cb62da-d525-4fd5-bd21-35b659525db9 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:02.927746 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d2cb62da-d525-4fd5-bd21-35b659525db9 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:02.929136 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d2cb62da-d525-4fd5-bd21-35b659525db9 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:02.929576 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d2cb62da-d525-4fd5-bd21-35b659525db9 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:02.943122 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-d2cb62da-d525-4fd5-bd21-35b659525db9 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] HTTP exception thrown: Instance a3819481-ecb7-47a2-86b2-78c6c1c40d61 could not be found. May 28 17:30:02.945393 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d2cb62da-d525-4fd5-bd21-35b659525db9 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Request method failure captured: May 28 17:30:02.945393 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61 HTTP/1.1 May 28 17:30:02.945393 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:30:02.945393 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:30:02.945393 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:30:02.945393 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 0 May 28 17:30:02.945393 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:30:02.945393 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:30:02.945393 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:30:02.945393 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:30:02.945393 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABiklstF3aOQRUbESyZry29fqSyyeE2N_R22Olnu9tAnyH-IumBfYLMvgbIDTq8Cb93CTaJ6ftKhXckT9qBJBTPZ77gK0Z3gEtGDj5iTB1eJBzZjYuQcrHOP4GKWQKfeLLqVaAIa0ut9MC8Y6erz9ebnkF5jKCig8JumlEt3h_lN-haBtA May 28 17:30:02.945393 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:30:02.945393 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:30:02.945393 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:30:02.945393 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:30:02.945393 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:30:02.945393 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:30:02.945393 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: dd6efc6e9dad4ab1b9c40ab78d5a360d May 28 17:30:02.945393 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-VolumesSnapshotTestJSON-491387215 May 28 17:30:02.945393 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:30:02.945393 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:30:02.946978 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd6efc6e9dad4ab1b9c40ab78d5a360d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dd6efc6e9dad4ab1b9c40ab78d5a360d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dd6efc6e9dad4ab1b9c40ab78d5a360d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dd6efc6e9dad4ab1b9c40ab78d5a360d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:30:02.946978 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-VolumesSnapshotTestJSON-491387215 May 28 17:30:02.946978 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: dd6efc6e9dad4ab1b9c40ab78d5a360d May 28 17:30:02.946978 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-491387215 May 28 17:30:02.946978 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-VolumesSnapshotTestJSON-491387215-project May 28 17:30:02.946978 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:30:02.946978 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:30:02.946978 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: b6a6d8ab7cc04e14b8f148412974e995 May 28 17:30:02.946978 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-VolumesSnapshotTestJSON-491387215-project May 28 17:30:02.946978 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: > May 28 17:30:02.946978 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Instance a3819481-ecb7-47a2-86b2-78c6c1c40d61 could not be found. May 28 17:30:02.946978 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'id': 'a3819481-ecb7-47a2-86b2-78c6c1c40d61'} May 28 17:30:02.947879 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:30:02.947879 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:30:02.947879 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:30:02.947879 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:30:02.947879 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:30:02.947879 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:30:02.947879 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:30:02.947879 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:30:02.947879 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:30:02.947879 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:30:02.947879 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3819481-ecb7-47a2-86b2-78c6c1c40d61 could not be found. May 28 17:30:02.947879 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:30:02.947879 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:30:02.947879 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:30:02.947879 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:30:02.947879 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:30:02.947879 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:30:02.947879 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:30:02.947879 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:30:02.947879 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:30:02.949318 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:30:02.949318 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:30:02.949318 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:30:02.949318 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:30:02.949318 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:30:02.949318 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:30:02.949318 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:30:02.949318 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3819481-ecb7-47a2-86b2-78c6c1c40d61 could not be found. May 28 17:30:02.949318 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:30:02.949318 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:30:02.949318 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:30:02.949318 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:30:02.949318 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:30:02.949318 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:30:02.949318 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:30:02.949318 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:30:02.949318 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3819481-ecb7-47a2-86b2-78c6c1c40d61 could not be found. May 28 17:30:02.949318 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:30:02.950762 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d2cb62da-d525-4fd5-bd21-35b659525db9 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] Returning 404 to user: Instance a3819481-ecb7-47a2-86b2-78c6c1c40d61 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:30:02.950762 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d2cb62da-d525-4fd5-bd21-35b659525db9 tempest-VolumesSnapshotTestJSON-491387215 tempest-VolumesSnapshotTestJSON-491387215-project] 10.222.0.33 "GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61" status: 404 len: 111 microversion: 2.1 time: 0.031897 May 28 17:30:02.950762 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 312/613] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:30:02 2022] GET /compute/v2.1/servers/a3819481-ecb7-47a2-86b2-78c6c1c40d61 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:30:03.273264 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-91d67f8f-98a5-4da0-85af-ea6d88d4fe77 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:03.273912 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-91d67f8f-98a5-4da0-85af-ea6d88d4fe77 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:03.280378 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-91d67f8f-98a5-4da0-85af-ea6d88d4fe77 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:03.280839 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-91d67f8f-98a5-4da0-85af-ea6d88d4fe77 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:03.281609 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-91d67f8f-98a5-4da0-85af-ea6d88d4fe77 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:03.282052 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-91d67f8f-98a5-4da0-85af-ea6d88d4fe77 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:03.414963 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-91d67f8f-98a5-4da0-85af-ea6d88d4fe77 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:03.422971 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-91d67f8f-98a5-4da0-85af-ea6d88d4fe77 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1712 microversion: 2.1 time: 0.153644 May 28 17:30:03.423570 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 302/614] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:30:03 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1712 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:30:21.744905 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c53d244e-8e90-43c5-bf9d-35d4861267af tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:21.745526 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c53d244e-8e90-43c5-bf9d-35d4861267af tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:21.747628 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:30:21.748248 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:30:21.754979 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c53d244e-8e90-43c5-bf9d-35d4861267af tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:21.755503 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c53d244e-8e90-43c5-bf9d-35d4861267af tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:21.757423 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c53d244e-8e90-43c5-bf9d-35d4861267af tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:21.757889 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c53d244e-8e90-43c5-bf9d-35d4861267af tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:21.786232 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c53d244e-8e90-43c5-bf9d-35d4861267af tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334/ips" status: 200 len: 152 microversion: 2.20 time: 0.046572 May 28 17:30:21.786794 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 313/615] 10.222.0.33 () {60 vars in 1288 bytes} [Sat May 28 17:30:21 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334/ips => generated 152 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 17:30:23.821027 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-76ddb9ce-d8f8-466f-a418-69d00b1d5433 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:30:23.821571 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-76ddb9ce-d8f8-466f-a418-69d00b1d5433 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:23.823914 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=15 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:30:23.824591 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=31 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:30:23.830378 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-76ddb9ce-d8f8-466f-a418-69d00b1d5433 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:23.830843 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-76ddb9ce-d8f8-466f-a418-69d00b1d5433 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:23.831623 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-76ddb9ce-d8f8-466f-a418-69d00b1d5433 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:23.832061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-76ddb9ce-d8f8-466f-a418-69d00b1d5433 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:23.855132 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-76ddb9ce-d8f8-466f-a418-69d00b1d5433 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lazy-loading 'flavor' on Instance uuid 1e52b200-7c75-45f2-92ed-813b306fc334 {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 17:30:24.111568 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-76ddb9ce-d8f8-466f-a418-69d00b1d5433 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "POST /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334/action" status: 202 len: 0 microversion: 2.20 time: 0.294997 May 28 17:30:24.112193 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 303/616] 10.222.0.33 () {62 vars in 1318 bytes} [Sat May 28 17:30:23 2022] POST /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 17:30:24.120570 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-025e5289-7352-4330-aa5c-93ac5ec67c7c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:24.121273 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-025e5289-7352-4330-aa5c-93ac5ec67c7c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:24.128085 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-025e5289-7352-4330-aa5c-93ac5ec67c7c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:24.128601 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-025e5289-7352-4330-aa5c-93ac5ec67c7c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:24.129360 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-025e5289-7352-4330-aa5c-93ac5ec67c7c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:24.129974 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-025e5289-7352-4330-aa5c-93ac5ec67c7c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:24.262523 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-025e5289-7352-4330-aa5c-93ac5ec67c7c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:24.270377 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-025e5289-7352-4330-aa5c-93ac5ec67c7c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:24.271914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-025e5289-7352-4330-aa5c-93ac5ec67c7c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:24.273159 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-025e5289-7352-4330-aa5c-93ac5ec67c7c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1725 microversion: 2.20 time: 0.156471 May 28 17:30:24.273714 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 314/617] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:30:24 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:30:25.293457 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3dd8ddbb-69ad-4751-bd61-a99e54406e8d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:25.294152 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3dd8ddbb-69ad-4751-bd61-a99e54406e8d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:25.300424 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3dd8ddbb-69ad-4751-bd61-a99e54406e8d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:25.300871 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3dd8ddbb-69ad-4751-bd61-a99e54406e8d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:25.301628 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3dd8ddbb-69ad-4751-bd61-a99e54406e8d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:25.302062 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3dd8ddbb-69ad-4751-bd61-a99e54406e8d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:25.429358 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3dd8ddbb-69ad-4751-bd61-a99e54406e8d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:25.437424 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3dd8ddbb-69ad-4751-bd61-a99e54406e8d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:25.438915 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3dd8ddbb-69ad-4751-bd61-a99e54406e8d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:25.440098 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3dd8ddbb-69ad-4751-bd61-a99e54406e8d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1725 microversion: 2.20 time: 0.151586 May 28 17:30:25.440658 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 304/618] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:30:25 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:30:26.457996 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9fe8993d-5f8a-43f7-b892-18d97d346815 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:26.458610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9fe8993d-5f8a-43f7-b892-18d97d346815 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:26.465698 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9fe8993d-5f8a-43f7-b892-18d97d346815 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:26.466146 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9fe8993d-5f8a-43f7-b892-18d97d346815 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:26.466907 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9fe8993d-5f8a-43f7-b892-18d97d346815 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:26.467355 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9fe8993d-5f8a-43f7-b892-18d97d346815 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:27.005511 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9fe8993d-5f8a-43f7-b892-18d97d346815 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:27.015023 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9fe8993d-5f8a-43f7-b892-18d97d346815 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:27.016557 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9fe8993d-5f8a-43f7-b892-18d97d346815 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:27.017718 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9fe8993d-5f8a-43f7-b892-18d97d346815 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1725 microversion: 2.20 time: 0.563665 May 28 17:30:27.018271 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 315/619] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:30:26 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1725 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:30:28.035737 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-55b8f38b-7bd8-4825-9bb5-f8d1b79aaf91 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:28.036361 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-55b8f38b-7bd8-4825-9bb5-f8d1b79aaf91 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:28.043066 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-55b8f38b-7bd8-4825-9bb5-f8d1b79aaf91 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:28.043568 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-55b8f38b-7bd8-4825-9bb5-f8d1b79aaf91 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:28.044336 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-55b8f38b-7bd8-4825-9bb5-f8d1b79aaf91 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:28.044776 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-55b8f38b-7bd8-4825-9bb5-f8d1b79aaf91 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:28.235196 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-55b8f38b-7bd8-4825-9bb5-f8d1b79aaf91 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:28.243630 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-55b8f38b-7bd8-4825-9bb5-f8d1b79aaf91 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:28.245173 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-55b8f38b-7bd8-4825-9bb5-f8d1b79aaf91 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:28.247162 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-55b8f38b-7bd8-4825-9bb5-f8d1b79aaf91 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1725 microversion: 2.20 time: 0.214699 May 28 17:30:28.247760 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 305/620] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:30:28 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:30:29.266146 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-acd27397-d968-417e-8ac2-7f801c497ac3 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:29.266753 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-acd27397-d968-417e-8ac2-7f801c497ac3 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:29.273348 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-acd27397-d968-417e-8ac2-7f801c497ac3 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:29.273788 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-acd27397-d968-417e-8ac2-7f801c497ac3 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:29.274540 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-acd27397-d968-417e-8ac2-7f801c497ac3 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:29.274965 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-acd27397-d968-417e-8ac2-7f801c497ac3 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:29.402308 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-acd27397-d968-417e-8ac2-7f801c497ac3 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:29.410421 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-acd27397-d968-417e-8ac2-7f801c497ac3 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:29.411969 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-acd27397-d968-417e-8ac2-7f801c497ac3 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:29.413143 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-acd27397-d968-417e-8ac2-7f801c497ac3 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1725 microversion: 2.20 time: 0.150854 May 28 17:30:29.414598 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 316/621] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:30:29 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:30:30.432619 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3ea01b0d-2fb8-42dc-a116-909484c6f17e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:30.433232 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3ea01b0d-2fb8-42dc-a116-909484c6f17e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:30.440377 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3ea01b0d-2fb8-42dc-a116-909484c6f17e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:30.440815 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3ea01b0d-2fb8-42dc-a116-909484c6f17e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:30.441572 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3ea01b0d-2fb8-42dc-a116-909484c6f17e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:30.442002 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3ea01b0d-2fb8-42dc-a116-909484c6f17e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:30.589802 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3ea01b0d-2fb8-42dc-a116-909484c6f17e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:30.610541 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3ea01b0d-2fb8-42dc-a116-909484c6f17e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:30.612853 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3ea01b0d-2fb8-42dc-a116-909484c6f17e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:30.614357 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3ea01b0d-2fb8-42dc-a116-909484c6f17e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1725 microversion: 2.20 time: 0.186313 May 28 17:30:30.614912 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 306/622] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:30:30 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:30:31.634767 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-776b9efa-1fce-4ec7-8d28-539ae687be59 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:31.635423 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-776b9efa-1fce-4ec7-8d28-539ae687be59 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:31.643459 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-776b9efa-1fce-4ec7-8d28-539ae687be59 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:31.643975 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-776b9efa-1fce-4ec7-8d28-539ae687be59 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:31.644784 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-776b9efa-1fce-4ec7-8d28-539ae687be59 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:31.645226 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-776b9efa-1fce-4ec7-8d28-539ae687be59 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:31.845751 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-776b9efa-1fce-4ec7-8d28-539ae687be59 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:31.856099 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-776b9efa-1fce-4ec7-8d28-539ae687be59 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:31.859157 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-776b9efa-1fce-4ec7-8d28-539ae687be59 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:31.860356 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-776b9efa-1fce-4ec7-8d28-539ae687be59 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1725 microversion: 2.20 time: 0.230117 May 28 17:30:31.861121 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 317/623] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:30:31 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1725 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:30:32.880014 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a70672e0-d2a9-4561-955a-c7b1b3ac6818 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:32.881201 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a70672e0-d2a9-4561-955a-c7b1b3ac6818 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:32.901119 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a70672e0-d2a9-4561-955a-c7b1b3ac6818 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:32.901573 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a70672e0-d2a9-4561-955a-c7b1b3ac6818 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:32.902356 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a70672e0-d2a9-4561-955a-c7b1b3ac6818 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:32.902794 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a70672e0-d2a9-4561-955a-c7b1b3ac6818 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:33.095295 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a70672e0-d2a9-4561-955a-c7b1b3ac6818 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:33.107501 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a70672e0-d2a9-4561-955a-c7b1b3ac6818 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:33.108996 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a70672e0-d2a9-4561-955a-c7b1b3ac6818 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:33.110203 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a70672e0-d2a9-4561-955a-c7b1b3ac6818 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1725 microversion: 2.20 time: 0.235024 May 28 17:30:33.110763 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 307/624] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:30:32 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1725 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:30:34.131526 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-7c0a55f2-44f5-4e9b-a6df-e187293d40da tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:34.132913 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-7c0a55f2-44f5-4e9b-a6df-e187293d40da tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:34.143625 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7c0a55f2-44f5-4e9b-a6df-e187293d40da tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:34.147151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7c0a55f2-44f5-4e9b-a6df-e187293d40da tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:34.150319 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7c0a55f2-44f5-4e9b-a6df-e187293d40da tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:34.150846 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7c0a55f2-44f5-4e9b-a6df-e187293d40da tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:34.429655 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7c0a55f2-44f5-4e9b-a6df-e187293d40da tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:34.444283 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7c0a55f2-44f5-4e9b-a6df-e187293d40da tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:34.449412 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7c0a55f2-44f5-4e9b-a6df-e187293d40da tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:34.451605 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-7c0a55f2-44f5-4e9b-a6df-e187293d40da tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1725 microversion: 2.20 time: 0.325392 May 28 17:30:34.463957 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 318/625] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:30:34 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1725 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:30:35.471083 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-88caed90-4979-4d60-bd35-e1622a8bbc58 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:35.471929 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-88caed90-4979-4d60-bd35-e1622a8bbc58 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:35.484194 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-88caed90-4979-4d60-bd35-e1622a8bbc58 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:35.484705 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-88caed90-4979-4d60-bd35-e1622a8bbc58 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:35.485517 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-88caed90-4979-4d60-bd35-e1622a8bbc58 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:35.486033 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-88caed90-4979-4d60-bd35-e1622a8bbc58 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:35.705427 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-88caed90-4979-4d60-bd35-e1622a8bbc58 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:35.722130 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-88caed90-4979-4d60-bd35-e1622a8bbc58 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:35.723995 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-88caed90-4979-4d60-bd35-e1622a8bbc58 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:35.730722 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-88caed90-4979-4d60-bd35-e1622a8bbc58 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1725 microversion: 2.20 time: 0.264421 May 28 17:30:35.737922 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 308/626] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:30:35 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1725 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:30:36.750498 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c1000689-1a7f-4da3-86f5-6563dbf93251 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:36.752405 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c1000689-1a7f-4da3-86f5-6563dbf93251 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:36.763240 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c1000689-1a7f-4da3-86f5-6563dbf93251 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:36.763764 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c1000689-1a7f-4da3-86f5-6563dbf93251 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:36.767011 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c1000689-1a7f-4da3-86f5-6563dbf93251 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:36.767011 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c1000689-1a7f-4da3-86f5-6563dbf93251 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:37.060914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c1000689-1a7f-4da3-86f5-6563dbf93251 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:37.075890 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c1000689-1a7f-4da3-86f5-6563dbf93251 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:37.078293 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c1000689-1a7f-4da3-86f5-6563dbf93251 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:37.081138 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c1000689-1a7f-4da3-86f5-6563dbf93251 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1746 microversion: 2.20 time: 0.335285 May 28 17:30:37.081904 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 319/627] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:30:36 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1746 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:30:38.102240 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e0232279-f1e5-4f3e-81a1-948a88815125 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:38.103458 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-e0232279-f1e5-4f3e-81a1-948a88815125 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:38.112369 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e0232279-f1e5-4f3e-81a1-948a88815125 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:38.113200 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e0232279-f1e5-4f3e-81a1-948a88815125 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:38.115778 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e0232279-f1e5-4f3e-81a1-948a88815125 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:38.116688 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e0232279-f1e5-4f3e-81a1-948a88815125 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:38.310535 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-e0232279-f1e5-4f3e-81a1-948a88815125 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:38.325710 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-e0232279-f1e5-4f3e-81a1-948a88815125 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:38.327502 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-e0232279-f1e5-4f3e-81a1-948a88815125 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:38.328936 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-e0232279-f1e5-4f3e-81a1-948a88815125 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1746 microversion: 2.20 time: 0.232185 May 28 17:30:38.329849 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 309/628] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:30:38 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1746 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:30:39.357849 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ddcadd54-f8b8-41c8-b515-31c209a13be8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:39.359065 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ddcadd54-f8b8-41c8-b515-31c209a13be8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:39.367257 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ddcadd54-f8b8-41c8-b515-31c209a13be8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:39.372571 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ddcadd54-f8b8-41c8-b515-31c209a13be8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:39.373624 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ddcadd54-f8b8-41c8-b515-31c209a13be8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:39.374213 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ddcadd54-f8b8-41c8-b515-31c209a13be8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:39.704268 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ddcadd54-f8b8-41c8-b515-31c209a13be8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:39.717447 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ddcadd54-f8b8-41c8-b515-31c209a13be8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:39.721045 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ddcadd54-f8b8-41c8-b515-31c209a13be8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:39.722485 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ddcadd54-f8b8-41c8-b515-31c209a13be8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1746 microversion: 2.20 time: 0.378029 May 28 17:30:39.723226 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 320/629] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:30:39 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1746 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:30:40.750986 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ddd65b43-4fe4-4c9c-8501-f7c8d2bbe929 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:40.752401 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ddd65b43-4fe4-4c9c-8501-f7c8d2bbe929 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:40.763907 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ddd65b43-4fe4-4c9c-8501-f7c8d2bbe929 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:40.764823 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ddd65b43-4fe4-4c9c-8501-f7c8d2bbe929 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:40.765666 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ddd65b43-4fe4-4c9c-8501-f7c8d2bbe929 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:40.766176 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ddd65b43-4fe4-4c9c-8501-f7c8d2bbe929 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:41.382986 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ddd65b43-4fe4-4c9c-8501-f7c8d2bbe929 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:41.399903 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ddd65b43-4fe4-4c9c-8501-f7c8d2bbe929 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:41.401657 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ddd65b43-4fe4-4c9c-8501-f7c8d2bbe929 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:41.403524 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ddd65b43-4fe4-4c9c-8501-f7c8d2bbe929 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1746 microversion: 2.20 time: 0.664960 May 28 17:30:41.407020 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 310/630] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:30:40 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1746 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:30:42.424937 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-42d3654c-e36e-40de-8a49-2080ac5da213 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:42.427294 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-42d3654c-e36e-40de-8a49-2080ac5da213 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:42.434107 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-42d3654c-e36e-40de-8a49-2080ac5da213 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:42.434561 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-42d3654c-e36e-40de-8a49-2080ac5da213 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:42.435431 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-42d3654c-e36e-40de-8a49-2080ac5da213 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:42.436009 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-42d3654c-e36e-40de-8a49-2080ac5da213 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:42.553266 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-80dc9e0f-5296-49ee-a9c7-6c62c13e6ec4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Action: 'create', calling method: .version_select at 0x7f9eeff5a670>, body: {"keypair": {"name": "tempest-TestShelveInstance-1490599223", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAgxesuaNKLsUfTaYCyzklkdyJ+QPlo8wpMmeVTI1oivR3FiFLBHwzY26To7zZvxrTy6jA0ZzH9z/6o/5wrpNriMBXtCtrawqUJGDXpaBIgEbYNKNsZwfsl3A7KeD7zv8g=="}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:30:42.574378 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-80dc9e0f-5296-49ee-a9c7-6c62c13e6ec4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Getting quotas for project c1187f363c0d40ffaebe938d3201e0ad. Resources: {'key_pairs'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:30:42.579457 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-80dc9e0f-5296-49ee-a9c7-6c62c13e6ec4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Getting quotas for user 10c83f7ad6e94f34b7bd9a335ee52257 and project c1187f363c0d40ffaebe938d3201e0ad. Resources: {'key_pairs'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:30:42.604458 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-80dc9e0f-5296-49ee-a9c7-6c62c13e6ec4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.332342 May 28 17:30:42.605063 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 321/631] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 17:30:42 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:30:42.609839 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-42d3654c-e36e-40de-8a49-2080ac5da213 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:42.625944 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-42d3654c-e36e-40de-8a49-2080ac5da213 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:42.627754 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-42d3654c-e36e-40de-8a49-2080ac5da213 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:42.629190 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-42d3654c-e36e-40de-8a49-2080ac5da213 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1746 microversion: 2.20 time: 0.208162 May 28 17:30:42.629895 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 311/632] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:30:42 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1746 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:30:42.968085 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-29a4522e-28ed-45d7-9318-4989364351b5 req-094ca2b2-25f6-46b3-bef4-0387fbf05b1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e52b200-7c75-45f2-92ed-813b306fc334", "name": "network-vif-plugged", "status": "completed", "tag": "48f2ad05-071e-4e67-9258-657db8e5bedf"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:30:42.982141 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-29a4522e-28ed-45d7-9318-4989364351b5 req-094ca2b2-25f6-46b3-bef4-0387fbf05b1d service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:42.982587 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-29a4522e-28ed-45d7-9318-4989364351b5 req-094ca2b2-25f6-46b3-bef4-0387fbf05b1d service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:42.997915 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-29a4522e-28ed-45d7-9318-4989364351b5 req-094ca2b2-25f6-46b3-bef4-0387fbf05b1d service nova] Creating event network-vif-plugged:48f2ad05-071e-4e67-9258-657db8e5bedf for instance 1e52b200-7c75-45f2-92ed-813b306fc334 on hv-cinder-84372 May 28 17:30:43.006461 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-29a4522e-28ed-45d7-9318-4989364351b5 req-094ca2b2-25f6-46b3-bef4-0387fbf05b1d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042491 May 28 17:30:43.009382 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 322/633] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:30:43.651246 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-eb05fe10-3cd1-42cd-817c-8ff619bf8677 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:43.651926 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-eb05fe10-3cd1-42cd-817c-8ff619bf8677 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:43.661243 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-eb05fe10-3cd1-42cd-817c-8ff619bf8677 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:43.661805 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-eb05fe10-3cd1-42cd-817c-8ff619bf8677 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:43.662885 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-eb05fe10-3cd1-42cd-817c-8ff619bf8677 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:43.664064 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-eb05fe10-3cd1-42cd-817c-8ff619bf8677 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:43.830076 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-eb05fe10-3cd1-42cd-817c-8ff619bf8677 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:43.848883 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-eb05fe10-3cd1-42cd-817c-8ff619bf8677 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:43.850887 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-eb05fe10-3cd1-42cd-817c-8ff619bf8677 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:43.852437 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-eb05fe10-3cd1-42cd-817c-8ff619bf8677 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1741 microversion: 2.20 time: 0.206957 May 28 17:30:43.853011 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 312/634] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:30:43 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1741 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:30:44.882309 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-7090c6d1-bb10-483c-af37-59a7eea37965 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:44.883301 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-7090c6d1-bb10-483c-af37-59a7eea37965 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:44.896918 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7090c6d1-bb10-483c-af37-59a7eea37965 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:44.897868 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7090c6d1-bb10-483c-af37-59a7eea37965 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:44.899107 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7090c6d1-bb10-483c-af37-59a7eea37965 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:44.899807 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7090c6d1-bb10-483c-af37-59a7eea37965 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:45.119908 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7090c6d1-bb10-483c-af37-59a7eea37965 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:45.133500 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7090c6d1-bb10-483c-af37-59a7eea37965 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:45.137558 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7090c6d1-bb10-483c-af37-59a7eea37965 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:45.139984 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-7090c6d1-bb10-483c-af37-59a7eea37965 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1741 microversion: 2.20 time: 0.270313 May 28 17:30:45.141263 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 323/635] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:30:44 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1741 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:30:46.167449 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b0df9d76-8e2b-481d-ba1f-3ce017040b85 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:46.168893 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-b0df9d76-8e2b-481d-ba1f-3ce017040b85 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:46.176553 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b0df9d76-8e2b-481d-ba1f-3ce017040b85 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:46.177358 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b0df9d76-8e2b-481d-ba1f-3ce017040b85 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:46.178403 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b0df9d76-8e2b-481d-ba1f-3ce017040b85 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:46.179621 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b0df9d76-8e2b-481d-ba1f-3ce017040b85 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:46.368924 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b0df9d76-8e2b-481d-ba1f-3ce017040b85 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:46.380299 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b0df9d76-8e2b-481d-ba1f-3ce017040b85 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:46.381900 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b0df9d76-8e2b-481d-ba1f-3ce017040b85 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:46.383096 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b0df9d76-8e2b-481d-ba1f-3ce017040b85 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1741 microversion: 2.20 time: 0.224823 May 28 17:30:46.383711 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 313/636] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:30:46 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1741 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:30:47.402453 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9e2839b7-bd01-4941-9170-3c0815e3a264 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:47.403067 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9e2839b7-bd01-4941-9170-3c0815e3a264 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:47.409839 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9e2839b7-bd01-4941-9170-3c0815e3a264 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:47.410313 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9e2839b7-bd01-4941-9170-3c0815e3a264 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:47.412764 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9e2839b7-bd01-4941-9170-3c0815e3a264 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:47.414743 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9e2839b7-bd01-4941-9170-3c0815e3a264 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:47.574683 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9e2839b7-bd01-4941-9170-3c0815e3a264 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:47.583998 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9e2839b7-bd01-4941-9170-3c0815e3a264 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:47.591207 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9e2839b7-bd01-4941-9170-3c0815e3a264 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:47.592804 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9e2839b7-bd01-4941-9170-3c0815e3a264 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1741 microversion: 2.20 time: 0.194548 May 28 17:30:47.604954 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 324/637] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:30:47 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1741 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:30:48.614946 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b19aed58-a08e-454a-afbe-415d7cc32dc2 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:48.618066 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-b19aed58-a08e-454a-afbe-415d7cc32dc2 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:48.627658 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b19aed58-a08e-454a-afbe-415d7cc32dc2 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:48.628668 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b19aed58-a08e-454a-afbe-415d7cc32dc2 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:48.629712 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b19aed58-a08e-454a-afbe-415d7cc32dc2 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:48.630213 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b19aed58-a08e-454a-afbe-415d7cc32dc2 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:48.808573 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b19aed58-a08e-454a-afbe-415d7cc32dc2 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:48.820712 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b19aed58-a08e-454a-afbe-415d7cc32dc2 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:48.826297 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b19aed58-a08e-454a-afbe-415d7cc32dc2 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:48.828030 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b19aed58-a08e-454a-afbe-415d7cc32dc2 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1741 microversion: 2.20 time: 0.219368 May 28 17:30:48.839033 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 314/638] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:30:48 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1741 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:30:49.846515 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8e0ed150-36c4-4cc9-baca-ad838f863a0f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:49.847200 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8e0ed150-36c4-4cc9-baca-ad838f863a0f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:49.855574 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8e0ed150-36c4-4cc9-baca-ad838f863a0f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:49.856021 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8e0ed150-36c4-4cc9-baca-ad838f863a0f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:49.856781 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8e0ed150-36c4-4cc9-baca-ad838f863a0f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:49.857210 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8e0ed150-36c4-4cc9-baca-ad838f863a0f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:50.005769 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8e0ed150-36c4-4cc9-baca-ad838f863a0f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:50.014671 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8e0ed150-36c4-4cc9-baca-ad838f863a0f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:50.016202 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8e0ed150-36c4-4cc9-baca-ad838f863a0f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:50.017349 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8e0ed150-36c4-4cc9-baca-ad838f863a0f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1741 microversion: 2.20 time: 0.174894 May 28 17:30:50.017899 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 325/639] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:30:49 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:30:51.037357 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-82090ee9-13dd-4d7b-8393-115943943d1a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:51.038725 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-82090ee9-13dd-4d7b-8393-115943943d1a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:51.049286 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-82090ee9-13dd-4d7b-8393-115943943d1a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:51.049286 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-82090ee9-13dd-4d7b-8393-115943943d1a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:51.049286 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-82090ee9-13dd-4d7b-8393-115943943d1a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:51.049286 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-82090ee9-13dd-4d7b-8393-115943943d1a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:51.203931 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-82090ee9-13dd-4d7b-8393-115943943d1a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:51.213717 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-82090ee9-13dd-4d7b-8393-115943943d1a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:51.215452 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-82090ee9-13dd-4d7b-8393-115943943d1a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:51.216747 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-82090ee9-13dd-4d7b-8393-115943943d1a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1741 microversion: 2.20 time: 0.183844 May 28 17:30:51.217449 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 315/640] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:30:51 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1741 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:30:52.235601 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-533515c4-97ab-4544-90ba-7e76bcb93f01 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:52.236198 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-533515c4-97ab-4544-90ba-7e76bcb93f01 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:52.238675 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:30:52.244572 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-533515c4-97ab-4544-90ba-7e76bcb93f01 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:52.245026 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-533515c4-97ab-4544-90ba-7e76bcb93f01 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:52.245806 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-533515c4-97ab-4544-90ba-7e76bcb93f01 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:52.246313 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-533515c4-97ab-4544-90ba-7e76bcb93f01 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:52.251329 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=67 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:30:52.392525 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-533515c4-97ab-4544-90ba-7e76bcb93f01 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:52.402402 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-533515c4-97ab-4544-90ba-7e76bcb93f01 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:52.404298 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-533515c4-97ab-4544-90ba-7e76bcb93f01 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:52.405694 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-533515c4-97ab-4544-90ba-7e76bcb93f01 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1741 microversion: 2.20 time: 0.174018 May 28 17:30:52.406249 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 326/641] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:30:52 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1741 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:30:53.425072 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-85c5e38e-def8-460c-8184-7ba3976c78c7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:53.426341 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-85c5e38e-def8-460c-8184-7ba3976c78c7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:53.433599 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-85c5e38e-def8-460c-8184-7ba3976c78c7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:53.434049 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-85c5e38e-def8-460c-8184-7ba3976c78c7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:53.434811 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-85c5e38e-def8-460c-8184-7ba3976c78c7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:53.435250 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-85c5e38e-def8-460c-8184-7ba3976c78c7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:53.595830 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-85c5e38e-def8-460c-8184-7ba3976c78c7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:53.605358 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-85c5e38e-def8-460c-8184-7ba3976c78c7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:53.606853 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-85c5e38e-def8-460c-8184-7ba3976c78c7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:53.608075 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-85c5e38e-def8-460c-8184-7ba3976c78c7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1741 microversion: 2.20 time: 0.187034 May 28 17:30:53.619606 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 316/642] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:30:53 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1741 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:30:54.627371 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8862403d-cf02-4b84-bbb7-eea3f2c4f1d5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:54.627993 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8862403d-cf02-4b84-bbb7-eea3f2c4f1d5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:54.630062 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=4 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:30:54.637856 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8862403d-cf02-4b84-bbb7-eea3f2c4f1d5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:54.638343 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8862403d-cf02-4b84-bbb7-eea3f2c4f1d5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:54.639298 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8862403d-cf02-4b84-bbb7-eea3f2c4f1d5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:54.639950 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8862403d-cf02-4b84-bbb7-eea3f2c4f1d5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:54.812335 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8862403d-cf02-4b84-bbb7-eea3f2c4f1d5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:54.822218 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8862403d-cf02-4b84-bbb7-eea3f2c4f1d5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:54.823894 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8862403d-cf02-4b84-bbb7-eea3f2c4f1d5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:54.825057 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8862403d-cf02-4b84-bbb7-eea3f2c4f1d5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1741 microversion: 2.20 time: 0.202306 May 28 17:30:54.826915 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 327/643] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:30:54 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1741 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:30:55.843576 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-eda3d171-299d-46e3-98ce-886d8af3f3dd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:55.844195 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-eda3d171-299d-46e3-98ce-886d8af3f3dd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:55.846580 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=29 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:30:55.852134 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-eda3d171-299d-46e3-98ce-886d8af3f3dd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:55.852579 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-eda3d171-299d-46e3-98ce-886d8af3f3dd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:55.853339 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-eda3d171-299d-46e3-98ce-886d8af3f3dd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:55.853773 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-eda3d171-299d-46e3-98ce-886d8af3f3dd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:55.857831 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:30:55.982174 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-eda3d171-299d-46e3-98ce-886d8af3f3dd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:55.989990 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-eda3d171-299d-46e3-98ce-886d8af3f3dd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:55.991523 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-eda3d171-299d-46e3-98ce-886d8af3f3dd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:55.993290 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-eda3d171-299d-46e3-98ce-886d8af3f3dd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1741 microversion: 2.20 time: 0.153585 May 28 17:30:55.993850 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 317/644] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:30:55 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1741 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:30:57.012306 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a1da93f3-3f28-4b88-bacf-799c84bad186 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:57.012920 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a1da93f3-3f28-4b88-bacf-799c84bad186 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:57.019364 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a1da93f3-3f28-4b88-bacf-799c84bad186 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:57.019824 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a1da93f3-3f28-4b88-bacf-799c84bad186 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:57.020583 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a1da93f3-3f28-4b88-bacf-799c84bad186 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:57.021021 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a1da93f3-3f28-4b88-bacf-799c84bad186 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:57.222649 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a1da93f3-3f28-4b88-bacf-799c84bad186 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:57.231722 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a1da93f3-3f28-4b88-bacf-799c84bad186 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:57.233230 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a1da93f3-3f28-4b88-bacf-799c84bad186 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:57.234392 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a1da93f3-3f28-4b88-bacf-799c84bad186 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1723 microversion: 2.20 time: 0.226683 May 28 17:30:57.235028 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 328/645] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:30:57 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:30:58.253392 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-30eee1ab-98a5-43dd-b7a4-b8266a96826f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:58.254035 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-30eee1ab-98a5-43dd-b7a4-b8266a96826f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:58.261208 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-30eee1ab-98a5-43dd-b7a4-b8266a96826f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:58.261659 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-30eee1ab-98a5-43dd-b7a4-b8266a96826f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:58.262423 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-30eee1ab-98a5-43dd-b7a4-b8266a96826f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:58.262859 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-30eee1ab-98a5-43dd-b7a4-b8266a96826f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:58.397379 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-30eee1ab-98a5-43dd-b7a4-b8266a96826f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:58.405440 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-30eee1ab-98a5-43dd-b7a4-b8266a96826f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:58.406933 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-30eee1ab-98a5-43dd-b7a4-b8266a96826f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:58.408155 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-30eee1ab-98a5-43dd-b7a4-b8266a96826f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1723 microversion: 2.20 time: 0.158960 May 28 17:30:58.408718 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 318/646] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:30:58 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:30:58.774467 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0f4cba0e-f39e-4378-9f76-941ec0d5c4f2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:30:58.775443 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0f4cba0e-f39e-4378-9f76-941ec0d5c4f2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:58.781869 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0f4cba0e-f39e-4378-9f76-941ec0d5c4f2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:58.782314 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0f4cba0e-f39e-4378-9f76-941ec0d5c4f2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:58.783063 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0f4cba0e-f39e-4378-9f76-941ec0d5c4f2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:58.783525 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0f4cba0e-f39e-4378-9f76-941ec0d5c4f2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:58.852556 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0f4cba0e-f39e-4378-9f76-941ec0d5c4f2 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "POST /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a/action" status: 202 len: 0 microversion: 2.1 time: 0.081898 May 28 17:30:58.853173 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 329/647] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 17:30:58 2022] POST /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 17:30:58.861175 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b1ac3f1e-fc41-46df-8815-18118ac24ca1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:58.861788 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-b1ac3f1e-fc41-46df-8815-18118ac24ca1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:58.869045 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b1ac3f1e-fc41-46df-8815-18118ac24ca1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:58.869501 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b1ac3f1e-fc41-46df-8815-18118ac24ca1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:58.870270 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b1ac3f1e-fc41-46df-8815-18118ac24ca1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:58.870716 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b1ac3f1e-fc41-46df-8815-18118ac24ca1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:58.989555 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-ae35af21-e935-480c-9d88-469eb3e7b114 req-fb003b74-2b07-4302-9547-9bb357c95234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e52b200-7c75-45f2-92ed-813b306fc334", "name": "network-vif-unplugged", "status": "completed", "tag": "48f2ad05-071e-4e67-9258-657db8e5bedf"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:30:58.998618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-ae35af21-e935-480c-9d88-469eb3e7b114 req-fb003b74-2b07-4302-9547-9bb357c95234 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:58.999035 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-ae35af21-e935-480c-9d88-469eb3e7b114 req-fb003b74-2b07-4302-9547-9bb357c95234 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:59.011576 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-ae35af21-e935-480c-9d88-469eb3e7b114 req-fb003b74-2b07-4302-9547-9bb357c95234 service nova] Creating event network-vif-unplugged:48f2ad05-071e-4e67-9258-657db8e5bedf for instance 1e52b200-7c75-45f2-92ed-813b306fc334 on hv-cinder-84372 May 28 17:30:59.016346 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-ae35af21-e935-480c-9d88-469eb3e7b114 req-fb003b74-2b07-4302-9547-9bb357c95234 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042179 May 28 17:30:59.017129 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 330/648] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:30:59.025882 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b1ac3f1e-fc41-46df-8815-18118ac24ca1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:59.034096 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b1ac3f1e-fc41-46df-8815-18118ac24ca1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1750 microversion: 2.1 time: 0.176778 May 28 17:30:59.034654 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 319/649] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:30:58 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1750 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:30:59.427053 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-50a45d94-3e16-42a6-94b8-0bb6d164c4e7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:30:59.427913 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-50a45d94-3e16-42a6-94b8-0bb6d164c4e7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:30:59.434949 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-50a45d94-3e16-42a6-94b8-0bb6d164c4e7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:59.435423 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-50a45d94-3e16-42a6-94b8-0bb6d164c4e7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:59.436195 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-50a45d94-3e16-42a6-94b8-0bb6d164c4e7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:30:59.436634 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-50a45d94-3e16-42a6-94b8-0bb6d164c4e7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:30:59.633341 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-50a45d94-3e16-42a6-94b8-0bb6d164c4e7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:59.642360 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-50a45d94-3e16-42a6-94b8-0bb6d164c4e7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:59.644017 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-50a45d94-3e16-42a6-94b8-0bb6d164c4e7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:30:59.645741 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-50a45d94-3e16-42a6-94b8-0bb6d164c4e7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1723 microversion: 2.20 time: 0.223108 May 28 17:30:59.646789 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 331/650] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:30:59 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:31:00.051466 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1ed20f8c-16f2-4e40-ad40-ac57eeb00b67 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:00.052110 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1ed20f8c-16f2-4e40-ad40-ac57eeb00b67 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:00.059602 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1ed20f8c-16f2-4e40-ad40-ac57eeb00b67 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:00.060063 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1ed20f8c-16f2-4e40-ad40-ac57eeb00b67 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:00.060832 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1ed20f8c-16f2-4e40-ad40-ac57eeb00b67 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:00.061274 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1ed20f8c-16f2-4e40-ad40-ac57eeb00b67 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:00.211692 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1ed20f8c-16f2-4e40-ad40-ac57eeb00b67 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:00.219658 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1ed20f8c-16f2-4e40-ad40-ac57eeb00b67 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1750 microversion: 2.1 time: 0.171859 May 28 17:31:00.220233 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 320/651] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:00 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1750 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:00.664785 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2c9f8f41-898c-4a98-8e54-117c535cef1f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:00.665392 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2c9f8f41-898c-4a98-8e54-117c535cef1f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:00.672675 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2c9f8f41-898c-4a98-8e54-117c535cef1f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:00.673122 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2c9f8f41-898c-4a98-8e54-117c535cef1f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:00.673891 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2c9f8f41-898c-4a98-8e54-117c535cef1f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:00.674329 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2c9f8f41-898c-4a98-8e54-117c535cef1f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:00.806507 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-2c9f8f41-898c-4a98-8e54-117c535cef1f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:00.814800 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-2c9f8f41-898c-4a98-8e54-117c535cef1f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:00.816335 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-2c9f8f41-898c-4a98-8e54-117c535cef1f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:00.817488 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2c9f8f41-898c-4a98-8e54-117c535cef1f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1666 microversion: 2.20 time: 0.156599 May 28 17:31:00.818043 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 332/652] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:00 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1666 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:31:00.835444 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8bca03a2-ac26-4485-9ddc-e7867d2a7109 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a7d2b06-cc54-41b5-8dbb-a78e1d1d7911"}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:31:00.836751 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8bca03a2-ac26-4485-9ddc-e7867d2a7109 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:00.842645 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8bca03a2-ac26-4485-9ddc-e7867d2a7109 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:00.843085 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8bca03a2-ac26-4485-9ddc-e7867d2a7109 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:00.843861 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8bca03a2-ac26-4485-9ddc-e7867d2a7109 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:00.844290 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8bca03a2-ac26-4485-9ddc-e7867d2a7109 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:01.155187 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8bca03a2-ac26-4485-9ddc-e7867d2a7109 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "POST /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.323552 May 28 17:31:01.155894 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 321/653] 10.222.0.33 () {62 vars in 1363 bytes} [Sat May 28 17:31:00 2022] POST /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334/os-volume_attachments => generated 188 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 17:31:01.238460 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ae7c197a-676c-40ef-857b-d88174c78a0c tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:01.239072 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ae7c197a-676c-40ef-857b-d88174c78a0c tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:01.246908 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ae7c197a-676c-40ef-857b-d88174c78a0c tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:01.247385 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ae7c197a-676c-40ef-857b-d88174c78a0c tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:01.248162 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ae7c197a-676c-40ef-857b-d88174c78a0c tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:01.249620 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ae7c197a-676c-40ef-857b-d88174c78a0c tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:01.299747 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-bcce56d5-61b8-4390-9bbc-91e70fa55895 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:31:01.302134 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-bcce56d5-61b8-4390-9bbc-91e70fa55895 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:01.312091 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bcce56d5-61b8-4390-9bbc-91e70fa55895 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:01.312552 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bcce56d5-61b8-4390-9bbc-91e70fa55895 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:01.313526 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bcce56d5-61b8-4390-9bbc-91e70fa55895 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:01.315094 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bcce56d5-61b8-4390-9bbc-91e70fa55895 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:01.465306 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-bcce56d5-61b8-4390-9bbc-91e70fa55895 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "POST /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334/action" status: 202 len: 0 microversion: 2.20 time: 0.170751 May 28 17:31:01.466176 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 322/654] 10.222.0.33 () {62 vars in 1318 bytes} [Sat May 28 17:31:01 2022] POST /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 28 17:31:01.474797 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5c0be3c4-17e2-4fe6-a394-c14683accb0c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:01.475843 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5c0be3c4-17e2-4fe6-a394-c14683accb0c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:01.484898 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5c0be3c4-17e2-4fe6-a394-c14683accb0c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:01.485678 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5c0be3c4-17e2-4fe6-a394-c14683accb0c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:01.486694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5c0be3c4-17e2-4fe6-a394-c14683accb0c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:01.487787 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5c0be3c4-17e2-4fe6-a394-c14683accb0c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:01.651200 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ae7c197a-676c-40ef-857b-d88174c78a0c tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:01.651482 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5c0be3c4-17e2-4fe6-a394-c14683accb0c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:01.659618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ae7c197a-676c-40ef-857b-d88174c78a0c tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1755 microversion: 2.1 time: 0.425871 May 28 17:31:01.660196 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 333/655] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:01 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1755 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:31:01.667823 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5c0be3c4-17e2-4fe6-a394-c14683accb0c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:01.669471 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5c0be3c4-17e2-4fe6-a394-c14683accb0c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:01.670671 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5c0be3c4-17e2-4fe6-a394-c14683accb0c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1752 microversion: 2.20 time: 0.200393 May 28 17:31:01.671439 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 323/656] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:01 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1752 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:31:02.676751 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-85bd3d86-8e96-4bae-ae13-09c2a552ca5d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:02.677366 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-85bd3d86-8e96-4bae-ae13-09c2a552ca5d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:02.685328 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-85bd3d86-8e96-4bae-ae13-09c2a552ca5d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:02.685328 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-85bd3d86-8e96-4bae-ae13-09c2a552ca5d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:02.685884 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-85bd3d86-8e96-4bae-ae13-09c2a552ca5d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:02.686464 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-85bd3d86-8e96-4bae-ae13-09c2a552ca5d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:02.690504 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-785036d2-8750-43f3-9ff1-86a6fa307966 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:02.691203 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-785036d2-8750-43f3-9ff1-86a6fa307966 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:02.698189 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-785036d2-8750-43f3-9ff1-86a6fa307966 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:02.698715 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-785036d2-8750-43f3-9ff1-86a6fa307966 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:02.699586 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-785036d2-8750-43f3-9ff1-86a6fa307966 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:02.700111 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-785036d2-8750-43f3-9ff1-86a6fa307966 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:02.839759 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-85bd3d86-8e96-4bae-ae13-09c2a552ca5d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:02.842387 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-785036d2-8750-43f3-9ff1-86a6fa307966 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:02.847854 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-85bd3d86-8e96-4bae-ae13-09c2a552ca5d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1755 microversion: 2.1 time: 0.174919 May 28 17:31:02.848418 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 334/657] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:02 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:02.850542 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-785036d2-8750-43f3-9ff1-86a6fa307966 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:02.852918 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-785036d2-8750-43f3-9ff1-86a6fa307966 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:02.854073 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-785036d2-8750-43f3-9ff1-86a6fa307966 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1754 microversion: 2.20 time: 0.167685 May 28 17:31:02.854617 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 324/658] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:02 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:31:03.865526 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9f4051df-066d-4d60-95e2-0d253d7b64b1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:03.866147 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9f4051df-066d-4d60-95e2-0d253d7b64b1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:03.872767 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-afee716c-41e9-4dac-9328-2a33b1a57ed0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:03.873324 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9f4051df-066d-4d60-95e2-0d253d7b64b1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:03.873454 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-afee716c-41e9-4dac-9328-2a33b1a57ed0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:03.873779 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9f4051df-066d-4d60-95e2-0d253d7b64b1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:03.874550 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9f4051df-066d-4d60-95e2-0d253d7b64b1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:03.875022 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9f4051df-066d-4d60-95e2-0d253d7b64b1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:03.880098 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-afee716c-41e9-4dac-9328-2a33b1a57ed0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:03.880554 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-afee716c-41e9-4dac-9328-2a33b1a57ed0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:03.881312 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-afee716c-41e9-4dac-9328-2a33b1a57ed0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:03.881743 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-afee716c-41e9-4dac-9328-2a33b1a57ed0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:04.013809 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-afee716c-41e9-4dac-9328-2a33b1a57ed0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:04.016848 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9f4051df-066d-4d60-95e2-0d253d7b64b1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:04.023889 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-afee716c-41e9-4dac-9328-2a33b1a57ed0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:04.025606 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-afee716c-41e9-4dac-9328-2a33b1a57ed0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:04.025753 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9f4051df-066d-4d60-95e2-0d253d7b64b1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1755 microversion: 2.1 time: 0.164034 May 28 17:31:04.026170 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 335/659] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:03 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:04.026780 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-afee716c-41e9-4dac-9328-2a33b1a57ed0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1810 microversion: 2.20 time: 0.157858 May 28 17:31:04.027508 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 325/660] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:03 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:31:05.043457 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8281a2e8-65d4-467c-ac57-442eb92f17a8 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:05.044076 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8281a2e8-65d4-467c-ac57-442eb92f17a8 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:05.045078 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d932471c-65ee-479f-a336-f0a835ff22ff tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:05.045694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d932471c-65ee-479f-a336-f0a835ff22ff tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:05.050703 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8281a2e8-65d4-467c-ac57-442eb92f17a8 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:05.051153 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8281a2e8-65d4-467c-ac57-442eb92f17a8 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:05.051960 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8281a2e8-65d4-467c-ac57-442eb92f17a8 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:05.052104 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d932471c-65ee-479f-a336-f0a835ff22ff tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:05.052400 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8281a2e8-65d4-467c-ac57-442eb92f17a8 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:05.052555 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d932471c-65ee-479f-a336-f0a835ff22ff tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:05.053322 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d932471c-65ee-479f-a336-f0a835ff22ff tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:05.053759 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d932471c-65ee-479f-a336-f0a835ff22ff tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:05.199267 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d932471c-65ee-479f-a336-f0a835ff22ff tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:05.204590 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8281a2e8-65d4-467c-ac57-442eb92f17a8 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:05.209637 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d932471c-65ee-479f-a336-f0a835ff22ff tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:05.211640 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d932471c-65ee-479f-a336-f0a835ff22ff tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:05.212957 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d932471c-65ee-479f-a336-f0a835ff22ff tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1810 microversion: 2.20 time: 0.171699 May 28 17:31:05.213599 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 326/661] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:05 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:31:05.213949 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8281a2e8-65d4-467c-ac57-442eb92f17a8 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1755 microversion: 2.1 time: 0.175082 May 28 17:31:05.214724 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 336/662] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:05 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:06.231475 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5500c07d-a16c-483c-a6b1-77af5ad36387 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:06.232029 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e75aee92-8fcc-463f-943f-d29e522bc6aa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:06.232398 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e75aee92-8fcc-463f-943f-d29e522bc6aa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:06.233287 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5500c07d-a16c-483c-a6b1-77af5ad36387 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:06.239329 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e75aee92-8fcc-463f-943f-d29e522bc6aa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:06.239813 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e75aee92-8fcc-463f-943f-d29e522bc6aa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:06.240597 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e75aee92-8fcc-463f-943f-d29e522bc6aa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:06.241026 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5500c07d-a16c-483c-a6b1-77af5ad36387 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:06.241308 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e75aee92-8fcc-463f-943f-d29e522bc6aa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:06.242688 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5500c07d-a16c-483c-a6b1-77af5ad36387 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:06.243802 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5500c07d-a16c-483c-a6b1-77af5ad36387 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:06.244570 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5500c07d-a16c-483c-a6b1-77af5ad36387 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:06.408715 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e75aee92-8fcc-463f-943f-d29e522bc6aa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:06.418308 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e75aee92-8fcc-463f-943f-d29e522bc6aa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:06.419998 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e75aee92-8fcc-463f-943f-d29e522bc6aa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:06.421285 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e75aee92-8fcc-463f-943f-d29e522bc6aa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1810 microversion: 2.20 time: 0.193609 May 28 17:31:06.421911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 337/663] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:06 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1810 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:31:06.446271 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5500c07d-a16c-483c-a6b1-77af5ad36387 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:06.454145 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5500c07d-a16c-483c-a6b1-77af5ad36387 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1755 microversion: 2.1 time: 0.226491 May 28 17:31:06.454705 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 327/664] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:06 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1755 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:31:07.442068 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-49f8f28f-19c2-45e5-9c61-30532193a313 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:07.442772 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-49f8f28f-19c2-45e5-9c61-30532193a313 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:07.455612 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-49f8f28f-19c2-45e5-9c61-30532193a313 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:07.456072 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-49f8f28f-19c2-45e5-9c61-30532193a313 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:07.456863 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-49f8f28f-19c2-45e5-9c61-30532193a313 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:07.457304 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-49f8f28f-19c2-45e5-9c61-30532193a313 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:07.471925 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-380437be-84ea-4937-82c3-984859ac0d26 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:07.473145 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-380437be-84ea-4937-82c3-984859ac0d26 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:07.480069 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-380437be-84ea-4937-82c3-984859ac0d26 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:07.480609 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-380437be-84ea-4937-82c3-984859ac0d26 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:07.481386 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-380437be-84ea-4937-82c3-984859ac0d26 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:07.481830 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-380437be-84ea-4937-82c3-984859ac0d26 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:07.616337 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-49f8f28f-19c2-45e5-9c61-30532193a313 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:07.624861 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-49f8f28f-19c2-45e5-9c61-30532193a313 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:07.626357 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-49f8f28f-19c2-45e5-9c61-30532193a313 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:07.628031 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-49f8f28f-19c2-45e5-9c61-30532193a313 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1810 microversion: 2.20 time: 0.189833 May 28 17:31:07.628949 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 338/665] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:07 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1810 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:31:07.646468 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-380437be-84ea-4937-82c3-984859ac0d26 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:07.655100 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-380437be-84ea-4937-82c3-984859ac0d26 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1755 microversion: 2.1 time: 0.187080 May 28 17:31:07.655710 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 328/666] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:07 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:31:08.504476 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5f19ad51-4a6e-41d1-bfa0-996094d963a2 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1916202973", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1490599223", "security_groups": [{"name": "tempest-secgroup-smoke-1574109063"}], "networks": [{"uuid": "4a465d8b-8354-439d-89ca-5f701b554376"}], "block_device_mapping_v2": [{"uuid": "379aa5d0-dd69-41bd-8fd6-e11e20ece4f3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:31:08.634651 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.network.neutron [None req-5f19ad51-4a6e-41d1-bfa0-996094d963a2 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] validate_networks() for [('4a465d8b-8354-439d-89ca-5f701b554376', None, None, None, None, None)] {{(pid=117604) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 17:31:08.647299 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-916ca1c4-cf7d-4b01-9620-28a2f064a8de tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:08.648100 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-916ca1c4-cf7d-4b01-9620-28a2f064a8de tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:08.655860 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-916ca1c4-cf7d-4b01-9620-28a2f064a8de tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:08.656717 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-916ca1c4-cf7d-4b01-9620-28a2f064a8de tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:08.657728 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-916ca1c4-cf7d-4b01-9620-28a2f064a8de tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:08.658513 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-916ca1c4-cf7d-4b01-9620-28a2f064a8de tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:08.837522 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-916ca1c4-cf7d-4b01-9620-28a2f064a8de tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:08.846434 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-916ca1c4-cf7d-4b01-9620-28a2f064a8de tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:08.848548 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-916ca1c4-cf7d-4b01-9620-28a2f064a8de tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:08.849972 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-916ca1c4-cf7d-4b01-9620-28a2f064a8de tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1810 microversion: 2.20 time: 0.206588 May 28 17:31:08.850753 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 329/667] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:08 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1810 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:31:08.868134 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-521ae90e-de27-4162-a367-276d1315a1fc tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:08.869164 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-521ae90e-de27-4162-a367-276d1315a1fc tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:08.876436 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-521ae90e-de27-4162-a367-276d1315a1fc tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:08.877428 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-521ae90e-de27-4162-a367-276d1315a1fc tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:08.877963 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-521ae90e-de27-4162-a367-276d1315a1fc tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:08.878397 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-521ae90e-de27-4162-a367-276d1315a1fc tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:08.883085 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:31:09.058726 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-521ae90e-de27-4162-a367-276d1315a1fc tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:09.066551 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-521ae90e-de27-4162-a367-276d1315a1fc tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1755 microversion: 2.1 time: 0.214079 May 28 17:31:09.067119 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 330/668] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:08 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1755 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:09.120915 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-5f19ad51-4a6e-41d1-bfa0-996094d963a2 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Flavor limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 17:31:09.121360 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-5f19ad51-4a6e-41d1-bfa0-996094d963a2 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Image limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 17:31:09.121837 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-5f19ad51-4a6e-41d1-bfa0-996094d963a2 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Flavor pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 17:31:09.122253 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-5f19ad51-4a6e-41d1-bfa0-996094d963a2 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Image pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 17:31:09.122662 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-5f19ad51-4a6e-41d1-bfa0-996094d963a2 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 17:31:09.133921 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5f19ad51-4a6e-41d1-bfa0-996094d963a2 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:09.134728 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5f19ad51-4a6e-41d1-bfa0-996094d963a2 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:09.135742 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5f19ad51-4a6e-41d1-bfa0-996094d963a2 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:09.136275 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5f19ad51-4a6e-41d1-bfa0-996094d963a2 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:09.154680 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-5f19ad51-4a6e-41d1-bfa0-996094d963a2 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Getting quotas for project c1187f363c0d40ffaebe938d3201e0ad. Resources: {'instances', 'cores', 'ram'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:31:09.158581 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-5f19ad51-4a6e-41d1-bfa0-996094d963a2 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Getting quotas for user 10c83f7ad6e94f34b7bd9a335ee52257 and project c1187f363c0d40ffaebe938d3201e0ad. Resources: {'instances', 'cores', 'ram'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:31:09.218818 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5f19ad51-4a6e-41d1-bfa0-996094d963a2 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Going to run 1 instances... {{(pid=117604) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 17:31:09.220956 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5f19ad51-4a6e-41d1-bfa0-996094d963a2 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='379aa5d0-dd69-41bd-8fd6-e11e20ece4f3',volume_size=None,volume_type=None)] {{(pid=117604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 17:31:09.356318 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5f19ad51-4a6e-41d1-bfa0-996094d963a2 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.856803 May 28 17:31:09.361998 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 339/669] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 17:31:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 17:31:09.367420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1524c79f-0984-4d86-bdd7-40eb9ebca8ab tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:09.368399 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1524c79f-0984-4d86-bdd7-40eb9ebca8ab tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:09.435573 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1524c79f-0984-4d86-bdd7-40eb9ebca8ab tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:09.447080 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1524c79f-0984-4d86-bdd7-40eb9ebca8ab tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1089 microversion: 2.1 time: 0.083950 May 28 17:31:09.448638 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 331/670] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:09 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1089 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:09.870406 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-53b2dbfe-10ed-46e1-b783-5a941762b395 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:09.871018 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-53b2dbfe-10ed-46e1-b783-5a941762b395 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:09.878228 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-53b2dbfe-10ed-46e1-b783-5a941762b395 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:09.878676 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-53b2dbfe-10ed-46e1-b783-5a941762b395 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:09.879631 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-53b2dbfe-10ed-46e1-b783-5a941762b395 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:09.880072 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-53b2dbfe-10ed-46e1-b783-5a941762b395 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:10.017586 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-53b2dbfe-10ed-46e1-b783-5a941762b395 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:10.027710 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-53b2dbfe-10ed-46e1-b783-5a941762b395 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:10.029297 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-53b2dbfe-10ed-46e1-b783-5a941762b395 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:10.030586 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-53b2dbfe-10ed-46e1-b783-5a941762b395 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1810 microversion: 2.20 time: 0.165682 May 28 17:31:10.031314 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 340/671] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:09 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:31:10.083904 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ae591733-a91c-4f48-aaae-a9ba46e098ed tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:10.084527 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ae591733-a91c-4f48-aaae-a9ba46e098ed tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:10.091668 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ae591733-a91c-4f48-aaae-a9ba46e098ed tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:10.092117 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ae591733-a91c-4f48-aaae-a9ba46e098ed tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:10.092887 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ae591733-a91c-4f48-aaae-a9ba46e098ed tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:10.093325 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ae591733-a91c-4f48-aaae-a9ba46e098ed tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:10.241853 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ae591733-a91c-4f48-aaae-a9ba46e098ed tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:10.249818 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ae591733-a91c-4f48-aaae-a9ba46e098ed tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1755 microversion: 2.1 time: 0.169769 May 28 17:31:10.250374 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 332/672] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:10 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:10.465562 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-70ef9410-75c4-444b-8054-58084128472c tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:10.466182 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-70ef9410-75c4-444b-8054-58084128472c tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:10.472796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-70ef9410-75c4-444b-8054-58084128472c tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:10.473257 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-70ef9410-75c4-444b-8054-58084128472c tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:10.474047 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-70ef9410-75c4-444b-8054-58084128472c tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:10.474492 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-70ef9410-75c4-444b-8054-58084128472c tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:10.539036 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-70ef9410-75c4-444b-8054-58084128472c tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:10.547712 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-70ef9410-75c4-444b-8054-58084128472c tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1139 microversion: 2.1 time: 0.086000 May 28 17:31:10.548280 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 341/673] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:10 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1139 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:11.049468 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-116fbd7c-e017-4676-958d-3fac47ab0d6d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:11.050328 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-116fbd7c-e017-4676-958d-3fac47ab0d6d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:11.057502 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-116fbd7c-e017-4676-958d-3fac47ab0d6d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:11.057947 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-116fbd7c-e017-4676-958d-3fac47ab0d6d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:11.058721 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-116fbd7c-e017-4676-958d-3fac47ab0d6d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:11.059149 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-116fbd7c-e017-4676-958d-3fac47ab0d6d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:11.191216 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-116fbd7c-e017-4676-958d-3fac47ab0d6d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:11.200277 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-116fbd7c-e017-4676-958d-3fac47ab0d6d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:11.201971 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-116fbd7c-e017-4676-958d-3fac47ab0d6d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:11.203220 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-116fbd7c-e017-4676-958d-3fac47ab0d6d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1810 microversion: 2.20 time: 0.157727 May 28 17:31:11.203882 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 333/674] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:11 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:31:11.269319 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6e5b88d8-dc0b-4905-864c-eca75e7dcb33 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:11.269928 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6e5b88d8-dc0b-4905-864c-eca75e7dcb33 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:11.276661 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6e5b88d8-dc0b-4905-864c-eca75e7dcb33 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:11.277108 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6e5b88d8-dc0b-4905-864c-eca75e7dcb33 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:11.277890 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6e5b88d8-dc0b-4905-864c-eca75e7dcb33 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:11.278315 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6e5b88d8-dc0b-4905-864c-eca75e7dcb33 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:11.425552 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6e5b88d8-dc0b-4905-864c-eca75e7dcb33 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:11.434910 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6e5b88d8-dc0b-4905-864c-eca75e7dcb33 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1755 microversion: 2.1 time: 0.169521 May 28 17:31:11.435506 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 342/675] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:11 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:11.564959 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1050ce37-d568-4c7f-adff-4a398e752560 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:11.565601 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1050ce37-d568-4c7f-adff-4a398e752560 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:11.572808 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1050ce37-d568-4c7f-adff-4a398e752560 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:11.573373 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1050ce37-d568-4c7f-adff-4a398e752560 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:11.574219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1050ce37-d568-4c7f-adff-4a398e752560 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:11.574766 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1050ce37-d568-4c7f-adff-4a398e752560 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:11.639438 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1050ce37-d568-4c7f-adff-4a398e752560 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:11.647110 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1050ce37-d568-4c7f-adff-4a398e752560 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1139 microversion: 2.1 time: 0.086290 May 28 17:31:11.647914 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 334/676] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:11 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1139 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:12.221641 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1fd3ffb0-727c-4701-83e4-5153806a1538 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:12.222252 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1fd3ffb0-727c-4701-83e4-5153806a1538 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:12.228410 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1fd3ffb0-727c-4701-83e4-5153806a1538 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:12.228869 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1fd3ffb0-727c-4701-83e4-5153806a1538 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:12.229691 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1fd3ffb0-727c-4701-83e4-5153806a1538 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:12.230118 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1fd3ffb0-727c-4701-83e4-5153806a1538 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:12.232884 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:31:12.375786 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1fd3ffb0-727c-4701-83e4-5153806a1538 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:12.386441 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1fd3ffb0-727c-4701-83e4-5153806a1538 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:12.388424 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1fd3ffb0-727c-4701-83e4-5153806a1538 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:12.389756 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1fd3ffb0-727c-4701-83e4-5153806a1538 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1810 microversion: 2.20 time: 0.172131 May 28 17:31:12.390614 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 343/677] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:12 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:31:12.452324 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-cebdc92b-1113-4b45-a964-c12cbef881d5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:12.452921 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-cebdc92b-1113-4b45-a964-c12cbef881d5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:12.461901 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cebdc92b-1113-4b45-a964-c12cbef881d5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:12.462616 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cebdc92b-1113-4b45-a964-c12cbef881d5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:12.463779 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cebdc92b-1113-4b45-a964-c12cbef881d5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:12.464869 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cebdc92b-1113-4b45-a964-c12cbef881d5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:12.625785 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-cebdc92b-1113-4b45-a964-c12cbef881d5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:12.635447 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-cebdc92b-1113-4b45-a964-c12cbef881d5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1755 microversion: 2.1 time: 0.186850 May 28 17:31:12.636040 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 335/678] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:12 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:12.664666 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-171991bb-06f5-41c0-86a5-e4725a01f6e5 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:12.665285 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-171991bb-06f5-41c0-86a5-e4725a01f6e5 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:12.671410 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-171991bb-06f5-41c0-86a5-e4725a01f6e5 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:12.671871 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-171991bb-06f5-41c0-86a5-e4725a01f6e5 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:12.672653 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-171991bb-06f5-41c0-86a5-e4725a01f6e5 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:12.673097 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-171991bb-06f5-41c0-86a5-e4725a01f6e5 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:12.739555 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-171991bb-06f5-41c0-86a5-e4725a01f6e5 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:12.747464 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-171991bb-06f5-41c0-86a5-e4725a01f6e5 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1139 microversion: 2.1 time: 0.086793 May 28 17:31:12.748038 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 344/679] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:12 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1139 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:13.407362 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-fd6a04a4-fe45-433f-bc2b-4313f10223be tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:13.408094 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-fd6a04a4-fe45-433f-bc2b-4313f10223be tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:13.414949 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fd6a04a4-fe45-433f-bc2b-4313f10223be tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:13.415419 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fd6a04a4-fe45-433f-bc2b-4313f10223be tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:13.416190 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fd6a04a4-fe45-433f-bc2b-4313f10223be tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:13.416630 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fd6a04a4-fe45-433f-bc2b-4313f10223be tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:13.554195 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-fd6a04a4-fe45-433f-bc2b-4313f10223be tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:13.563144 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-fd6a04a4-fe45-433f-bc2b-4313f10223be tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:13.564727 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-fd6a04a4-fe45-433f-bc2b-4313f10223be tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:13.565884 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-fd6a04a4-fe45-433f-bc2b-4313f10223be tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1810 microversion: 2.20 time: 0.162479 May 28 17:31:13.566441 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 336/680] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:13 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:31:13.653272 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c3835b40-d639-4187-8ca4-8bd8ddb57035 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:13.653904 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c3835b40-d639-4187-8ca4-8bd8ddb57035 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:13.660321 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c3835b40-d639-4187-8ca4-8bd8ddb57035 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:13.660707 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c3835b40-d639-4187-8ca4-8bd8ddb57035 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:13.661462 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c3835b40-d639-4187-8ca4-8bd8ddb57035 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:13.661895 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c3835b40-d639-4187-8ca4-8bd8ddb57035 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:13.764338 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1dbabec8-853f-4d82-aff3-2977833d1c64 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:13.764962 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1dbabec8-853f-4d82-aff3-2977833d1c64 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:13.773534 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1dbabec8-853f-4d82-aff3-2977833d1c64 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:13.774357 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1dbabec8-853f-4d82-aff3-2977833d1c64 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:13.775880 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1dbabec8-853f-4d82-aff3-2977833d1c64 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:13.776533 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1dbabec8-853f-4d82-aff3-2977833d1c64 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:13.826144 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c3835b40-d639-4187-8ca4-8bd8ddb57035 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:13.836306 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c3835b40-d639-4187-8ca4-8bd8ddb57035 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1755 microversion: 2.1 time: 0.186837 May 28 17:31:13.837366 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 345/681] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:13 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:13.864965 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1dbabec8-853f-4d82-aff3-2977833d1c64 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:13.873335 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1dbabec8-853f-4d82-aff3-2977833d1c64 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1139 microversion: 2.1 time: 0.112662 May 28 17:31:13.874108 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 337/682] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:13 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1139 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:14.584960 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ee178e9d-5599-41d5-83ad-2d852ee64617 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:14.586301 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ee178e9d-5599-41d5-83ad-2d852ee64617 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:14.593061 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ee178e9d-5599-41d5-83ad-2d852ee64617 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:14.593768 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ee178e9d-5599-41d5-83ad-2d852ee64617 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:14.594787 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ee178e9d-5599-41d5-83ad-2d852ee64617 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:14.595315 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ee178e9d-5599-41d5-83ad-2d852ee64617 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:14.743239 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ee178e9d-5599-41d5-83ad-2d852ee64617 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:14.752522 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ee178e9d-5599-41d5-83ad-2d852ee64617 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:14.754069 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ee178e9d-5599-41d5-83ad-2d852ee64617 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:14.755243 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ee178e9d-5599-41d5-83ad-2d852ee64617 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1810 microversion: 2.20 time: 0.174536 May 28 17:31:14.755839 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 346/683] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:14 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:31:14.854152 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0964753c-0517-4fdc-a885-9accb9b40926 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:14.854924 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0964753c-0517-4fdc-a885-9accb9b40926 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:14.861600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0964753c-0517-4fdc-a885-9accb9b40926 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:14.862056 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0964753c-0517-4fdc-a885-9accb9b40926 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:14.862839 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0964753c-0517-4fdc-a885-9accb9b40926 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:14.863280 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0964753c-0517-4fdc-a885-9accb9b40926 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:14.892122 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9425f9ab-c5b0-4289-b14e-924e21cee46b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:14.892745 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9425f9ab-c5b0-4289-b14e-924e21cee46b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:14.899108 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9425f9ab-c5b0-4289-b14e-924e21cee46b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:14.899589 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9425f9ab-c5b0-4289-b14e-924e21cee46b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:14.900367 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9425f9ab-c5b0-4289-b14e-924e21cee46b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:14.900807 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9425f9ab-c5b0-4289-b14e-924e21cee46b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:14.967257 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9425f9ab-c5b0-4289-b14e-924e21cee46b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:14.981895 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9425f9ab-c5b0-4289-b14e-924e21cee46b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1139 microversion: 2.1 time: 0.093430 May 28 17:31:14.983130 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 347/684] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:14 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1139 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:15.040128 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0964753c-0517-4fdc-a885-9accb9b40926 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:15.048962 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0964753c-0517-4fdc-a885-9accb9b40926 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1755 microversion: 2.1 time: 0.199275 May 28 17:31:15.050494 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 338/685] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:14 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1755 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:15.774249 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-199ec4ba-c83e-4c69-a3e8-27c18cabe658 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:15.774839 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-199ec4ba-c83e-4c69-a3e8-27c18cabe658 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:15.781377 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-199ec4ba-c83e-4c69-a3e8-27c18cabe658 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:15.781818 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-199ec4ba-c83e-4c69-a3e8-27c18cabe658 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:15.782570 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-199ec4ba-c83e-4c69-a3e8-27c18cabe658 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:15.783000 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-199ec4ba-c83e-4c69-a3e8-27c18cabe658 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:15.916095 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-199ec4ba-c83e-4c69-a3e8-27c18cabe658 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:15.924952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-199ec4ba-c83e-4c69-a3e8-27c18cabe658 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:15.926399 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-199ec4ba-c83e-4c69-a3e8-27c18cabe658 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:15.927589 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-199ec4ba-c83e-4c69-a3e8-27c18cabe658 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1810 microversion: 2.20 time: 0.157887 May 28 17:31:15.928150 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 348/686] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:15 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:31:15.999046 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0b0c046b-37fc-43ee-93dc-36d3d135e37c tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:15.999716 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0b0c046b-37fc-43ee-93dc-36d3d135e37c tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:16.006454 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0b0c046b-37fc-43ee-93dc-36d3d135e37c tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:16.006905 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0b0c046b-37fc-43ee-93dc-36d3d135e37c tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:16.008444 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0b0c046b-37fc-43ee-93dc-36d3d135e37c tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:16.008878 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0b0c046b-37fc-43ee-93dc-36d3d135e37c tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:16.066809 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5865f624-a7a0-4182-a5af-0d6dc7127995 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:16.067481 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5865f624-a7a0-4182-a5af-0d6dc7127995 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:16.068709 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0b0c046b-37fc-43ee-93dc-36d3d135e37c tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:16.074933 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5865f624-a7a0-4182-a5af-0d6dc7127995 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:16.075506 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5865f624-a7a0-4182-a5af-0d6dc7127995 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:16.076467 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5865f624-a7a0-4182-a5af-0d6dc7127995 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:16.077001 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5865f624-a7a0-4182-a5af-0d6dc7127995 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:16.077146 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0b0c046b-37fc-43ee-93dc-36d3d135e37c tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1139 microversion: 2.1 time: 0.081975 May 28 17:31:16.077660 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 339/687] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:15 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:16.216942 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5865f624-a7a0-4182-a5af-0d6dc7127995 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:16.224770 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5865f624-a7a0-4182-a5af-0d6dc7127995 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1755 microversion: 2.1 time: 0.162111 May 28 17:31:16.225317 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 349/688] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:16 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:31:16.946025 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-18d14894-b327-4034-bcc8-f1cd1e0aeaa1 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:16.946624 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-18d14894-b327-4034-bcc8-f1cd1e0aeaa1 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:16.952627 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-18d14894-b327-4034-bcc8-f1cd1e0aeaa1 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:16.953076 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-18d14894-b327-4034-bcc8-f1cd1e0aeaa1 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:16.953821 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-18d14894-b327-4034-bcc8-f1cd1e0aeaa1 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:16.954254 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-18d14894-b327-4034-bcc8-f1cd1e0aeaa1 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:17.093237 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-18d14894-b327-4034-bcc8-f1cd1e0aeaa1 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:17.093840 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-7edb35d6-04d0-44b0-b43b-a63072848172 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:17.094463 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-7edb35d6-04d0-44b0-b43b-a63072848172 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:17.100881 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7edb35d6-04d0-44b0-b43b-a63072848172 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:17.101347 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7edb35d6-04d0-44b0-b43b-a63072848172 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:17.101930 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-18d14894-b327-4034-bcc8-f1cd1e0aeaa1 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:17.102432 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7edb35d6-04d0-44b0-b43b-a63072848172 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:17.102874 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7edb35d6-04d0-44b0-b43b-a63072848172 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:17.103519 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-18d14894-b327-4034-bcc8-f1cd1e0aeaa1 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:17.104695 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-18d14894-b327-4034-bcc8-f1cd1e0aeaa1 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1810 microversion: 2.20 time: 0.162674 May 28 17:31:17.105251 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 340/689] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:16 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:31:17.163041 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7edb35d6-04d0-44b0-b43b-a63072848172 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:17.170374 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-7edb35d6-04d0-44b0-b43b-a63072848172 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1139 microversion: 2.1 time: 0.080402 May 28 17:31:17.170925 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 350/690] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:17 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:17.242073 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c722765f-978e-4187-a5a7-3976e4d47a06 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:17.242777 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c722765f-978e-4187-a5a7-3976e4d47a06 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:17.248675 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c722765f-978e-4187-a5a7-3976e4d47a06 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:17.249114 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c722765f-978e-4187-a5a7-3976e4d47a06 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:17.249862 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c722765f-978e-4187-a5a7-3976e4d47a06 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:17.250291 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c722765f-978e-4187-a5a7-3976e4d47a06 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:17.395309 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c722765f-978e-4187-a5a7-3976e4d47a06 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:17.403867 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c722765f-978e-4187-a5a7-3976e4d47a06 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1755 microversion: 2.1 time: 0.165757 May 28 17:31:17.404435 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 341/691] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:17 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:18.123574 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-136af1c4-8c22-4c8a-9039-2a153b974aa5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:18.124084 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-136af1c4-8c22-4c8a-9039-2a153b974aa5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:18.130869 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-136af1c4-8c22-4c8a-9039-2a153b974aa5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:18.131313 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-136af1c4-8c22-4c8a-9039-2a153b974aa5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:18.132191 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-136af1c4-8c22-4c8a-9039-2a153b974aa5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:18.132675 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-136af1c4-8c22-4c8a-9039-2a153b974aa5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:18.194018 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4626974f-29c8-45b8-ab0a-b3ef188faf0e tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:18.194663 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4626974f-29c8-45b8-ab0a-b3ef188faf0e tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:18.201551 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4626974f-29c8-45b8-ab0a-b3ef188faf0e tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:18.202132 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4626974f-29c8-45b8-ab0a-b3ef188faf0e tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:18.202982 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4626974f-29c8-45b8-ab0a-b3ef188faf0e tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:18.203897 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4626974f-29c8-45b8-ab0a-b3ef188faf0e tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:18.267957 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4626974f-29c8-45b8-ab0a-b3ef188faf0e tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:18.276457 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4626974f-29c8-45b8-ab0a-b3ef188faf0e tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1139 microversion: 2.1 time: 0.090433 May 28 17:31:18.277023 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 342/692] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:18 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1139 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:31:18.286361 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-136af1c4-8c22-4c8a-9039-2a153b974aa5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:18.295387 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-136af1c4-8c22-4c8a-9039-2a153b974aa5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:18.296915 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-136af1c4-8c22-4c8a-9039-2a153b974aa5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:18.298076 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-136af1c4-8c22-4c8a-9039-2a153b974aa5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1810 microversion: 2.20 time: 0.178691 May 28 17:31:18.298717 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 351/693] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:18 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1810 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:31:18.421330 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-84531a40-96bb-448f-a057-86a6d6cfa9e5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:18.421869 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-84531a40-96bb-448f-a057-86a6d6cfa9e5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:18.427918 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-84531a40-96bb-448f-a057-86a6d6cfa9e5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:18.428364 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-84531a40-96bb-448f-a057-86a6d6cfa9e5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:18.429176 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-84531a40-96bb-448f-a057-86a6d6cfa9e5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:18.429722 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-84531a40-96bb-448f-a057-86a6d6cfa9e5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:18.572864 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-84531a40-96bb-448f-a057-86a6d6cfa9e5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:18.580717 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-84531a40-96bb-448f-a057-86a6d6cfa9e5 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1755 microversion: 2.1 time: 0.163356 May 28 17:31:18.581280 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 343/694] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:18 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:19.293134 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-65c2f33a-0611-4b14-8ea9-4908ebb0f7cd tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:19.293743 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-65c2f33a-0611-4b14-8ea9-4908ebb0f7cd tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:19.296137 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:31:19.296928 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=6 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:31:19.303003 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-65c2f33a-0611-4b14-8ea9-4908ebb0f7cd tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:19.303497 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-65c2f33a-0611-4b14-8ea9-4908ebb0f7cd tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:19.304299 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-65c2f33a-0611-4b14-8ea9-4908ebb0f7cd tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:19.304738 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-65c2f33a-0611-4b14-8ea9-4908ebb0f7cd tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:19.316692 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ce1dbc6d-2390-478b-8f6b-9212c9f32afa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:19.317329 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ce1dbc6d-2390-478b-8f6b-9212c9f32afa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:19.324590 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ce1dbc6d-2390-478b-8f6b-9212c9f32afa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:19.325041 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ce1dbc6d-2390-478b-8f6b-9212c9f32afa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:19.325812 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ce1dbc6d-2390-478b-8f6b-9212c9f32afa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:19.326254 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ce1dbc6d-2390-478b-8f6b-9212c9f32afa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:19.367716 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-65c2f33a-0611-4b14-8ea9-4908ebb0f7cd tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:19.375226 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-65c2f33a-0611-4b14-8ea9-4908ebb0f7cd tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1131 microversion: 2.1 time: 0.086153 May 28 17:31:19.375844 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 352/695] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:19 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1131 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:19.446393 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=2 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:31:19.457807 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ce1dbc6d-2390-478b-8f6b-9212c9f32afa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:19.466976 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ce1dbc6d-2390-478b-8f6b-9212c9f32afa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:19.468518 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ce1dbc6d-2390-478b-8f6b-9212c9f32afa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:19.469686 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ce1dbc6d-2390-478b-8f6b-9212c9f32afa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1810 microversion: 2.20 time: 0.156921 May 28 17:31:19.470255 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 344/696] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:19 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:31:19.598155 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-dbd426d4-e45a-4475-8b59-0f4d98e39900 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:19.599093 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-dbd426d4-e45a-4475-8b59-0f4d98e39900 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:19.606113 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dbd426d4-e45a-4475-8b59-0f4d98e39900 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:19.606679 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dbd426d4-e45a-4475-8b59-0f4d98e39900 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:19.607684 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dbd426d4-e45a-4475-8b59-0f4d98e39900 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:19.608246 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-dbd426d4-e45a-4475-8b59-0f4d98e39900 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:19.748576 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-dbd426d4-e45a-4475-8b59-0f4d98e39900 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:19.756765 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-dbd426d4-e45a-4475-8b59-0f4d98e39900 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1755 microversion: 2.1 time: 0.162733 May 28 17:31:19.757530 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 353/697] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:19 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:20.103237 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-01a65e9c-a363-4092-808d-14e87d306b9c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "465869b4-b705-4b7e-8b8f-31b1e46391b9"}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:31:20.104383 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-01a65e9c-a363-4092-808d-14e87d306b9c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:20.110380 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-01a65e9c-a363-4092-808d-14e87d306b9c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:20.110830 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-01a65e9c-a363-4092-808d-14e87d306b9c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:20.111728 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-01a65e9c-a363-4092-808d-14e87d306b9c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:20.112165 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-01a65e9c-a363-4092-808d-14e87d306b9c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:20.392960 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d56ae5ca-2de5-423d-b7b5-077fd31c1763 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:20.393484 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d56ae5ca-2de5-423d-b7b5-077fd31c1763 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:20.400361 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d56ae5ca-2de5-423d-b7b5-077fd31c1763 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:20.400815 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d56ae5ca-2de5-423d-b7b5-077fd31c1763 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:20.401609 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d56ae5ca-2de5-423d-b7b5-077fd31c1763 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:20.402043 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d56ae5ca-2de5-423d-b7b5-077fd31c1763 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:20.466157 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d56ae5ca-2de5-423d-b7b5-077fd31c1763 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:20.473471 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d56ae5ca-2de5-423d-b7b5-077fd31c1763 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1187 microversion: 2.1 time: 0.084482 May 28 17:31:20.474020 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 354/698] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:20 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:31:20.487633 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-464b1566-9f56-43a6-b6ed-5d2a97c826a0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:20.488245 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-464b1566-9f56-43a6-b6ed-5d2a97c826a0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:20.495317 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-464b1566-9f56-43a6-b6ed-5d2a97c826a0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:20.495800 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-464b1566-9f56-43a6-b6ed-5d2a97c826a0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:20.496572 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-464b1566-9f56-43a6-b6ed-5d2a97c826a0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:20.497009 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-464b1566-9f56-43a6-b6ed-5d2a97c826a0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:20.623330 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-464b1566-9f56-43a6-b6ed-5d2a97c826a0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:20.632092 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-464b1566-9f56-43a6-b6ed-5d2a97c826a0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:20.633730 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-464b1566-9f56-43a6-b6ed-5d2a97c826a0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:20.634880 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-464b1566-9f56-43a6-b6ed-5d2a97c826a0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1810 microversion: 2.20 time: 0.151022 May 28 17:31:20.635693 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 355/699] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:20 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:31:20.775151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b56676d9-3287-4451-b953-fd4d9c1572b1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:20.775810 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b56676d9-3287-4451-b953-fd4d9c1572b1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:20.781865 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b56676d9-3287-4451-b953-fd4d9c1572b1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:20.782314 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b56676d9-3287-4451-b953-fd4d9c1572b1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:20.783073 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b56676d9-3287-4451-b953-fd4d9c1572b1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:20.783545 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b56676d9-3287-4451-b953-fd4d9c1572b1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:20.925940 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b56676d9-3287-4451-b953-fd4d9c1572b1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:20.933853 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b56676d9-3287-4451-b953-fd4d9c1572b1 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1755 microversion: 2.1 time: 0.163246 May 28 17:31:20.934407 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 356/700] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:20 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:31:21.492209 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-aece6748-c8db-45d5-aeb3-8d5ce6f6dc8a tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:21.492901 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-aece6748-c8db-45d5-aeb3-8d5ce6f6dc8a tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:21.499290 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aece6748-c8db-45d5-aeb3-8d5ce6f6dc8a tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:21.499786 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aece6748-c8db-45d5-aeb3-8d5ce6f6dc8a tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:21.500575 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aece6748-c8db-45d5-aeb3-8d5ce6f6dc8a tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:21.501012 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aece6748-c8db-45d5-aeb3-8d5ce6f6dc8a tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:21.573793 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-aece6748-c8db-45d5-aeb3-8d5ce6f6dc8a tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:21.581299 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-aece6748-c8db-45d5-aeb3-8d5ce6f6dc8a tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1187 microversion: 2.1 time: 0.093620 May 28 17:31:21.581862 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 357/701] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:21 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1187 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:31:21.653265 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-30fa033e-9634-4f39-ab88-7067e2039a90 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:21.653883 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-30fa033e-9634-4f39-ab88-7067e2039a90 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:21.659855 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-30fa033e-9634-4f39-ab88-7067e2039a90 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:21.660309 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-30fa033e-9634-4f39-ab88-7067e2039a90 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:21.661072 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-30fa033e-9634-4f39-ab88-7067e2039a90 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:21.661513 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-30fa033e-9634-4f39-ab88-7067e2039a90 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:21.788221 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-30fa033e-9634-4f39-ab88-7067e2039a90 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:21.797151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-30fa033e-9634-4f39-ab88-7067e2039a90 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:21.798652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-30fa033e-9634-4f39-ab88-7067e2039a90 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:21.799866 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-30fa033e-9634-4f39-ab88-7067e2039a90 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1810 microversion: 2.20 time: 0.150669 May 28 17:31:21.800419 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 358/702] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:21 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:31:21.951025 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-15ee36a8-aeb9-4f0f-ab74-f4183decbd40 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:21.951658 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-15ee36a8-aeb9-4f0f-ab74-f4183decbd40 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:21.958487 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-15ee36a8-aeb9-4f0f-ab74-f4183decbd40 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:21.959196 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-15ee36a8-aeb9-4f0f-ab74-f4183decbd40 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:21.961763 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-15ee36a8-aeb9-4f0f-ab74-f4183decbd40 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:21.961980 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-15ee36a8-aeb9-4f0f-ab74-f4183decbd40 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:21.962358 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-01a65e9c-a363-4092-808d-14e87d306b9c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "POST /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.964061 May 28 17:31:21.962970 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 345/703] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 17:31:19 2022] POST /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9/os-volume_attachments => generated 194 bytes in 1966 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:31:22.213078 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-15ee36a8-aeb9-4f0f-ab74-f4183decbd40 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:22.215278 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=100 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:31:22.222387 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-15ee36a8-aeb9-4f0f-ab74-f4183decbd40 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1758 microversion: 2.1 time: 0.275628 May 28 17:31:22.222964 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 359/704] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:21 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1758 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:22.599093 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-fd4cd322-9e14-4d8d-8f6e-98fe2f59e56d tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:22.599952 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-fd4cd322-9e14-4d8d-8f6e-98fe2f59e56d tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:22.606792 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fd4cd322-9e14-4d8d-8f6e-98fe2f59e56d tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:22.607216 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fd4cd322-9e14-4d8d-8f6e-98fe2f59e56d tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:22.608028 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fd4cd322-9e14-4d8d-8f6e-98fe2f59e56d tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:22.608465 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fd4cd322-9e14-4d8d-8f6e-98fe2f59e56d tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:22.624769 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:31:22.678457 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-fd4cd322-9e14-4d8d-8f6e-98fe2f59e56d tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:22.686781 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-fd4cd322-9e14-4d8d-8f6e-98fe2f59e56d tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1205 microversion: 2.1 time: 0.092413 May 28 17:31:22.687369 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 346/705] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:22 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1205 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:22.818050 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0767afc6-c21d-4d75-a5f9-f32be11f7a68 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:22.818848 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0767afc6-c21d-4d75-a5f9-f32be11f7a68 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:22.825415 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:31:22.827607 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0767afc6-c21d-4d75-a5f9-f32be11f7a68 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:22.828232 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0767afc6-c21d-4d75-a5f9-f32be11f7a68 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:22.829180 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0767afc6-c21d-4d75-a5f9-f32be11f7a68 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:22.829682 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0767afc6-c21d-4d75-a5f9-f32be11f7a68 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:23.078015 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0767afc6-c21d-4d75-a5f9-f32be11f7a68 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:23.086738 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0767afc6-c21d-4d75-a5f9-f32be11f7a68 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:23.088284 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0767afc6-c21d-4d75-a5f9-f32be11f7a68 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:23.089461 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0767afc6-c21d-4d75-a5f9-f32be11f7a68 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1810 microversion: 2.20 time: 0.275273 May 28 17:31:23.090015 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 360/706] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:22 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1810 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:31:23.705537 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-31864827-ce09-4cfc-b2fd-e626d2696a6f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:23.706364 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-31864827-ce09-4cfc-b2fd-e626d2696a6f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:23.727038 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-31864827-ce09-4cfc-b2fd-e626d2696a6f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:23.727872 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-31864827-ce09-4cfc-b2fd-e626d2696a6f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:23.728572 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-31864827-ce09-4cfc-b2fd-e626d2696a6f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:23.729075 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-31864827-ce09-4cfc-b2fd-e626d2696a6f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:23.748591 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-40407149-0466-466f-95e9-f2497d5cf6b5 req-9c2eebc6-f6f6-430a-ab82-ddea1eab6f49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "281e6309-8591-49e7-ab2a-e36aa0fad594", "tag": "50d0ffcf-e908-48f5-9b29-2b70709081b6"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:31:23.757188 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-40407149-0466-466f-95e9-f2497d5cf6b5 req-9c2eebc6-f6f6-430a-ab82-ddea1eab6f49 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:23.758562 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-40407149-0466-466f-95e9-f2497d5cf6b5 req-9c2eebc6-f6f6-430a-ab82-ddea1eab6f49 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:23.771354 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-40407149-0466-466f-95e9-f2497d5cf6b5 req-9c2eebc6-f6f6-430a-ab82-ddea1eab6f49 service nova] Creating event network-changed:50d0ffcf-e908-48f5-9b29-2b70709081b6 for instance 281e6309-8591-49e7-ab2a-e36aa0fad594 on hv-cinder-84372 May 28 17:31:23.776717 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-40407149-0466-466f-95e9-f2497d5cf6b5 req-9c2eebc6-f6f6-430a-ab82-ddea1eab6f49 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111537 May 28 17:31:23.777418 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 347/707] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:31:23.956953 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-31864827-ce09-4cfc-b2fd-e626d2696a6f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:23.969010 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-31864827-ce09-4cfc-b2fd-e626d2696a6f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1273 microversion: 2.1 time: 0.267813 May 28 17:31:23.969856 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 361/708] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:23 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1273 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:24.110248 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4d7886a4-9b61-495b-adff-b7edcda2bc7d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:24.111144 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4d7886a4-9b61-495b-adff-b7edcda2bc7d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:24.117431 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4d7886a4-9b61-495b-adff-b7edcda2bc7d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:24.117886 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4d7886a4-9b61-495b-adff-b7edcda2bc7d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:24.118656 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4d7886a4-9b61-495b-adff-b7edcda2bc7d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:24.119090 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4d7886a4-9b61-495b-adff-b7edcda2bc7d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:24.260530 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4d7886a4-9b61-495b-adff-b7edcda2bc7d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:24.270151 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4d7886a4-9b61-495b-adff-b7edcda2bc7d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:24.271662 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4d7886a4-9b61-495b-adff-b7edcda2bc7d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:24.272867 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4d7886a4-9b61-495b-adff-b7edcda2bc7d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1810 microversion: 2.20 time: 0.168012 May 28 17:31:24.273436 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 348/709] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:24 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:31:24.987949 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d7f0ce99-f06c-46f7-a8ec-08b3dd728804 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:24.988567 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d7f0ce99-f06c-46f7-a8ec-08b3dd728804 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:24.995150 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d7f0ce99-f06c-46f7-a8ec-08b3dd728804 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:24.995637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d7f0ce99-f06c-46f7-a8ec-08b3dd728804 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:24.996398 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d7f0ce99-f06c-46f7-a8ec-08b3dd728804 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:24.996833 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d7f0ce99-f06c-46f7-a8ec-08b3dd728804 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:25.122701 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d7f0ce99-f06c-46f7-a8ec-08b3dd728804 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:25.130334 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d7f0ce99-f06c-46f7-a8ec-08b3dd728804 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1273 microversion: 2.1 time: 0.146186 May 28 17:31:25.130907 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 362/710] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:24 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1273 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:25.291321 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3d7b06fc-1822-4104-8a7b-21c7dad9e501 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:25.291966 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3d7b06fc-1822-4104-8a7b-21c7dad9e501 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:25.298401 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3d7b06fc-1822-4104-8a7b-21c7dad9e501 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:25.298886 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3d7b06fc-1822-4104-8a7b-21c7dad9e501 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:25.299696 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3d7b06fc-1822-4104-8a7b-21c7dad9e501 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:25.300135 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3d7b06fc-1822-4104-8a7b-21c7dad9e501 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:25.429215 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3d7b06fc-1822-4104-8a7b-21c7dad9e501 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:25.437614 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3d7b06fc-1822-4104-8a7b-21c7dad9e501 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:25.439114 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3d7b06fc-1822-4104-8a7b-21c7dad9e501 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:25.440306 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3d7b06fc-1822-4104-8a7b-21c7dad9e501 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1810 microversion: 2.20 time: 0.152887 May 28 17:31:25.440862 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 349/711] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:25 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:31:26.147168 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6b0d8a97-e9d5-4a49-ad18-cd0926bfdfe5 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:26.147730 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6b0d8a97-e9d5-4a49-ad18-cd0926bfdfe5 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:26.154231 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6b0d8a97-e9d5-4a49-ad18-cd0926bfdfe5 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:26.154676 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6b0d8a97-e9d5-4a49-ad18-cd0926bfdfe5 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:26.155469 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6b0d8a97-e9d5-4a49-ad18-cd0926bfdfe5 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:26.155914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6b0d8a97-e9d5-4a49-ad18-cd0926bfdfe5 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:26.290214 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6b0d8a97-e9d5-4a49-ad18-cd0926bfdfe5 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:26.297545 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6b0d8a97-e9d5-4a49-ad18-cd0926bfdfe5 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1273 microversion: 2.1 time: 0.154338 May 28 17:31:26.298100 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 363/712] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:26 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1273 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:26.458141 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-92fd3d11-4ab2-4d82-a374-02a8c6ee9ce7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:26.458755 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-92fd3d11-4ab2-4d82-a374-02a8c6ee9ce7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:26.461989 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=70 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:31:26.467354 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-92fd3d11-4ab2-4d82-a374-02a8c6ee9ce7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:26.467821 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-92fd3d11-4ab2-4d82-a374-02a8c6ee9ce7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:26.468593 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-92fd3d11-4ab2-4d82-a374-02a8c6ee9ce7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:26.469038 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-92fd3d11-4ab2-4d82-a374-02a8c6ee9ce7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:26.600324 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-92fd3d11-4ab2-4d82-a374-02a8c6ee9ce7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:26.609334 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-92fd3d11-4ab2-4d82-a374-02a8c6ee9ce7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:26.610845 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-92fd3d11-4ab2-4d82-a374-02a8c6ee9ce7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:26.612057 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-92fd3d11-4ab2-4d82-a374-02a8c6ee9ce7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1810 microversion: 2.20 time: 0.157849 May 28 17:31:26.612614 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 350/713] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:26 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:31:27.315116 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-907ed923-18f6-4b2d-984f-1f67c1c3e2f9 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:27.315749 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-907ed923-18f6-4b2d-984f-1f67c1c3e2f9 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:27.324215 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-907ed923-18f6-4b2d-984f-1f67c1c3e2f9 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:27.324891 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-907ed923-18f6-4b2d-984f-1f67c1c3e2f9 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:27.325875 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-907ed923-18f6-4b2d-984f-1f67c1c3e2f9 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:27.326571 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-907ed923-18f6-4b2d-984f-1f67c1c3e2f9 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:27.456180 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-907ed923-18f6-4b2d-984f-1f67c1c3e2f9 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:27.463956 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-907ed923-18f6-4b2d-984f-1f67c1c3e2f9 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1273 microversion: 2.1 time: 0.152781 May 28 17:31:27.464556 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 364/714] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:27 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1273 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:27.630694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d97f3945-3fbe-4b98-8a36-6b95391317f7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:27.631224 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d97f3945-3fbe-4b98-8a36-6b95391317f7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:27.637899 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d97f3945-3fbe-4b98-8a36-6b95391317f7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:27.638350 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d97f3945-3fbe-4b98-8a36-6b95391317f7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:27.639146 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d97f3945-3fbe-4b98-8a36-6b95391317f7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:27.639622 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d97f3945-3fbe-4b98-8a36-6b95391317f7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:27.768522 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d97f3945-3fbe-4b98-8a36-6b95391317f7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:27.777003 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d97f3945-3fbe-4b98-8a36-6b95391317f7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:27.778497 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d97f3945-3fbe-4b98-8a36-6b95391317f7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:27.779690 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d97f3945-3fbe-4b98-8a36-6b95391317f7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1810 microversion: 2.20 time: 0.153176 May 28 17:31:27.780252 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 351/715] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:27 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:31:28.480184 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4ed23928-8ad0-4b8c-8680-6a6948a7c693 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:28.480184 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-4ed23928-8ad0-4b8c-8680-6a6948a7c693 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:28.486673 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4ed23928-8ad0-4b8c-8680-6a6948a7c693 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:28.487115 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4ed23928-8ad0-4b8c-8680-6a6948a7c693 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:28.487905 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4ed23928-8ad0-4b8c-8680-6a6948a7c693 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:28.488340 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4ed23928-8ad0-4b8c-8680-6a6948a7c693 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:28.614734 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-4ed23928-8ad0-4b8c-8680-6a6948a7c693 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:28.622017 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-4ed23928-8ad0-4b8c-8680-6a6948a7c693 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1273 microversion: 2.1 time: 0.146173 May 28 17:31:28.622581 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 365/716] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:28 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1273 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:28.797998 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c363784b-febc-4c2e-9b10-8e64333cd132 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:28.798637 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c363784b-febc-4c2e-9b10-8e64333cd132 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:28.806004 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c363784b-febc-4c2e-9b10-8e64333cd132 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:28.806449 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c363784b-febc-4c2e-9b10-8e64333cd132 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:28.807200 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c363784b-febc-4c2e-9b10-8e64333cd132 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:28.807662 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c363784b-febc-4c2e-9b10-8e64333cd132 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:28.934189 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c363784b-febc-4c2e-9b10-8e64333cd132 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:28.942446 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c363784b-febc-4c2e-9b10-8e64333cd132 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:28.943959 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c363784b-febc-4c2e-9b10-8e64333cd132 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:28.945993 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c363784b-febc-4c2e-9b10-8e64333cd132 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1810 microversion: 2.20 time: 0.151170 May 28 17:31:28.946576 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 352/717] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:28 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:31:29.638117 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-eb5fd480-c685-491c-9899-38c6fcf7b7a9 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:29.638663 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-eb5fd480-c685-491c-9899-38c6fcf7b7a9 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:29.645235 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-eb5fd480-c685-491c-9899-38c6fcf7b7a9 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:29.645685 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-eb5fd480-c685-491c-9899-38c6fcf7b7a9 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:29.646447 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-eb5fd480-c685-491c-9899-38c6fcf7b7a9 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:29.646886 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-eb5fd480-c685-491c-9899-38c6fcf7b7a9 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:29.786224 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-eb5fd480-c685-491c-9899-38c6fcf7b7a9 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:29.794535 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-eb5fd480-c685-491c-9899-38c6fcf7b7a9 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1273 microversion: 2.1 time: 0.160359 May 28 17:31:29.795097 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 366/718] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:29 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1273 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:29.965612 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7b5e2275-6d8f-4f07-b797-9e87fee43950 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:29.966317 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7b5e2275-6d8f-4f07-b797-9e87fee43950 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:29.973206 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7b5e2275-6d8f-4f07-b797-9e87fee43950 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:29.974553 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7b5e2275-6d8f-4f07-b797-9e87fee43950 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:29.975592 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7b5e2275-6d8f-4f07-b797-9e87fee43950 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:29.976818 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7b5e2275-6d8f-4f07-b797-9e87fee43950 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:30.116103 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7b5e2275-6d8f-4f07-b797-9e87fee43950 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:30.124519 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7b5e2275-6d8f-4f07-b797-9e87fee43950 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:30.126018 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7b5e2275-6d8f-4f07-b797-9e87fee43950 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:30.127168 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7b5e2275-6d8f-4f07-b797-9e87fee43950 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1810 microversion: 2.20 time: 0.165591 May 28 17:31:30.128028 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 353/719] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:29 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:31:30.529606 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9d3acb93-90a7-4739-ad8c-459a8728b17d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:31:30.530919 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9d3acb93-90a7-4739-ad8c-459a8728b17d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:30.537423 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9d3acb93-90a7-4739-ad8c-459a8728b17d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:30.537967 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9d3acb93-90a7-4739-ad8c-459a8728b17d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:30.539018 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9d3acb93-90a7-4739-ad8c-459a8728b17d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:30.539576 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9d3acb93-90a7-4739-ad8c-459a8728b17d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:30.565381 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-9d3acb93-90a7-4739-ad8c-459a8728b17d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lazy-loading 'flavor' on Instance uuid 435314f8-f9b7-4e9c-94f3-8a84190965b9 {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 17:31:30.719813 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9d3acb93-90a7-4739-ad8c-459a8728b17d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "POST /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9/action" status: 200 len: 32 microversion: 2.1 time: 0.193849 May 28 17:31:30.721701 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 367/720] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 17:31:30 2022] POST /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9/action => generated 32 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 17:31:30.730597 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3ca35455-5d52-4c55-9918-8cd6109984b7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:30.731244 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3ca35455-5d52-4c55-9918-8cd6109984b7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:30.737602 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3ca35455-5d52-4c55-9918-8cd6109984b7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:30.738043 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3ca35455-5d52-4c55-9918-8cd6109984b7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:30.738842 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3ca35455-5d52-4c55-9918-8cd6109984b7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:30.739272 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3ca35455-5d52-4c55-9918-8cd6109984b7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:30.812190 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3b93d20c-612b-472e-a758-56275ee311e0 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:30.813204 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3b93d20c-612b-472e-a758-56275ee311e0 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:30.820448 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3b93d20c-612b-472e-a758-56275ee311e0 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:30.820911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3b93d20c-612b-472e-a758-56275ee311e0 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:30.821910 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3b93d20c-612b-472e-a758-56275ee311e0 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:30.822349 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3b93d20c-612b-472e-a758-56275ee311e0 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:30.880684 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3ca35455-5d52-4c55-9918-8cd6109984b7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:30.890150 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3ca35455-5d52-4c55-9918-8cd6109984b7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1734 microversion: 2.1 time: 0.163461 May 28 17:31:30.890736 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 354/721] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:30 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:31:30.990291 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-3b93d20c-612b-472e-a758-56275ee311e0 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:30.998672 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3b93d20c-612b-472e-a758-56275ee311e0 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1261 microversion: 2.1 time: 0.190834 May 28 17:31:30.999269 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 368/722] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:30 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1261 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:31.145537 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c99aa00c-8cc3-4c3b-8a43-17281ae0d9d6 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:31.146144 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c99aa00c-8cc3-4c3b-8a43-17281ae0d9d6 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:31.153002 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c99aa00c-8cc3-4c3b-8a43-17281ae0d9d6 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:31.153450 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c99aa00c-8cc3-4c3b-8a43-17281ae0d9d6 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:31.154240 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c99aa00c-8cc3-4c3b-8a43-17281ae0d9d6 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:31.154676 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c99aa00c-8cc3-4c3b-8a43-17281ae0d9d6 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:31.288206 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c99aa00c-8cc3-4c3b-8a43-17281ae0d9d6 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:31.297580 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c99aa00c-8cc3-4c3b-8a43-17281ae0d9d6 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:31.299103 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c99aa00c-8cc3-4c3b-8a43-17281ae0d9d6 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:31.300477 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c99aa00c-8cc3-4c3b-8a43-17281ae0d9d6 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1810 microversion: 2.20 time: 0.159076 May 28 17:31:31.301040 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 355/723] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:31 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:31:31.384193 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b81f88a5-95c0-4863-bf2f-19980ccb9f69 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:31.384698 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b81f88a5-95c0-4863-bf2f-19980ccb9f69 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:31.391221 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b81f88a5-95c0-4863-bf2f-19980ccb9f69 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:31.391894 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b81f88a5-95c0-4863-bf2f-19980ccb9f69 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:31.392760 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b81f88a5-95c0-4863-bf2f-19980ccb9f69 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:31.393198 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b81f88a5-95c0-4863-bf2f-19980ccb9f69 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:31.423044 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-a2723b66-e66c-4fbc-91b7-7b4afb44c594 req-508ce180-bcc0-4558-a835-bf34b36dd012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e52b200-7c75-45f2-92ed-813b306fc334", "name": "network-vif-plugged", "status": "completed", "tag": "48f2ad05-071e-4e67-9258-657db8e5bedf"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:31:31.433311 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-a2723b66-e66c-4fbc-91b7-7b4afb44c594 req-508ce180-bcc0-4558-a835-bf34b36dd012 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:31.433783 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-a2723b66-e66c-4fbc-91b7-7b4afb44c594 req-508ce180-bcc0-4558-a835-bf34b36dd012 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:31.444674 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-a2723b66-e66c-4fbc-91b7-7b4afb44c594 req-508ce180-bcc0-4558-a835-bf34b36dd012 service nova] Creating event network-vif-plugged:48f2ad05-071e-4e67-9258-657db8e5bedf for instance 1e52b200-7c75-45f2-92ed-813b306fc334 on hv-cinder-84372 May 28 17:31:31.450572 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-a2723b66-e66c-4fbc-91b7-7b4afb44c594 req-508ce180-bcc0-4558-a835-bf34b36dd012 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103987 May 28 17:31:31.451096 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 356/724] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:31:31.478504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-b81f88a5-95c0-4863-bf2f-19980ccb9f69 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lazy-loading 'services' on Instance uuid 3b3c1f29-31c9-4f5c-9875-fd1939062512 {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 17:31:31.552864 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b81f88a5-95c0-4863-bf2f-19980ccb9f69 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512/os-volume_attachments/5342cd3c-6160-4b9c-b932-90b80bcfec57" status: 202 len: 0 microversion: 2.1 time: 0.284944 May 28 17:31:31.553446 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 369/725] 10.222.0.33 () {58 vars in 1415 bytes} [Sat May 28 17:31:31 2022] DELETE /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512/os-volume_attachments/5342cd3c-6160-4b9c-b932-90b80bcfec57 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 17:31:31.907709 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3d4d1cba-2348-4798-854d-db69bd7ad0f8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:31.908399 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3d4d1cba-2348-4798-854d-db69bd7ad0f8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:31.914640 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3d4d1cba-2348-4798-854d-db69bd7ad0f8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:31.915087 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3d4d1cba-2348-4798-854d-db69bd7ad0f8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:31.915899 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3d4d1cba-2348-4798-854d-db69bd7ad0f8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:31.916332 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3d4d1cba-2348-4798-854d-db69bd7ad0f8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:32.017176 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3fef9c8a-3676-4e11-92d1-e2e42e68a6c6 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:32.017888 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3fef9c8a-3676-4e11-92d1-e2e42e68a6c6 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:32.024984 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3fef9c8a-3676-4e11-92d1-e2e42e68a6c6 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:32.025447 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3fef9c8a-3676-4e11-92d1-e2e42e68a6c6 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:32.026218 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3fef9c8a-3676-4e11-92d1-e2e42e68a6c6 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:32.026656 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3fef9c8a-3676-4e11-92d1-e2e42e68a6c6 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:32.047190 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3d4d1cba-2348-4798-854d-db69bd7ad0f8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:32.057993 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3d4d1cba-2348-4798-854d-db69bd7ad0f8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1734 microversion: 2.1 time: 0.154305 May 28 17:31:32.058573 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 357/726] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:31 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:32.204255 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-3fef9c8a-3676-4e11-92d1-e2e42e68a6c6 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:32.214125 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3fef9c8a-3676-4e11-92d1-e2e42e68a6c6 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1261 microversion: 2.1 time: 0.201578 May 28 17:31:32.214698 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 370/727] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:32 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1261 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:31:32.318312 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-65babbfe-92d9-4903-b907-a5f4be19cb04 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:32.318952 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-65babbfe-92d9-4903-b907-a5f4be19cb04 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:32.326626 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-65babbfe-92d9-4903-b907-a5f4be19cb04 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:32.327071 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-65babbfe-92d9-4903-b907-a5f4be19cb04 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:32.327859 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-65babbfe-92d9-4903-b907-a5f4be19cb04 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:32.328539 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-65babbfe-92d9-4903-b907-a5f4be19cb04 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:32.460085 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-65babbfe-92d9-4903-b907-a5f4be19cb04 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:32.469046 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-65babbfe-92d9-4903-b907-a5f4be19cb04 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:32.470529 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-65babbfe-92d9-4903-b907-a5f4be19cb04 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:32.471719 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-65babbfe-92d9-4903-b907-a5f4be19cb04 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1810 microversion: 2.20 time: 0.157553 May 28 17:31:32.472276 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 358/728] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:32 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:31:33.075874 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-fca4f67c-61c3-4f34-9d1f-4f3153482356 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:33.076548 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-fca4f67c-61c3-4f34-9d1f-4f3153482356 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:33.086958 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fca4f67c-61c3-4f34-9d1f-4f3153482356 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:33.087732 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fca4f67c-61c3-4f34-9d1f-4f3153482356 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:33.089164 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fca4f67c-61c3-4f34-9d1f-4f3153482356 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:33.089606 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fca4f67c-61c3-4f34-9d1f-4f3153482356 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:33.224169 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-fca4f67c-61c3-4f34-9d1f-4f3153482356 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:33.230051 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8aed32ad-1051-4711-b785-20ef6d5a2830 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:33.230750 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8aed32ad-1051-4711-b785-20ef6d5a2830 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:33.232528 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-fca4f67c-61c3-4f34-9d1f-4f3153482356 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1734 microversion: 2.1 time: 0.160736 May 28 17:31:33.233092 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 371/729] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:33 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:33.237003 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8aed32ad-1051-4711-b785-20ef6d5a2830 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:33.237545 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8aed32ad-1051-4711-b785-20ef6d5a2830 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:33.238406 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8aed32ad-1051-4711-b785-20ef6d5a2830 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:33.238911 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8aed32ad-1051-4711-b785-20ef6d5a2830 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:33.367769 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8aed32ad-1051-4711-b785-20ef6d5a2830 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:33.375357 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8aed32ad-1051-4711-b785-20ef6d5a2830 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1261 microversion: 2.1 time: 0.149198 May 28 17:31:33.375937 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 359/730] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:33 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:31:33.490627 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d7c064fb-e2a1-4c97-88ed-a04c0954d31c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:33.491251 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d7c064fb-e2a1-4c97-88ed-a04c0954d31c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:33.497860 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d7c064fb-e2a1-4c97-88ed-a04c0954d31c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:33.498315 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d7c064fb-e2a1-4c97-88ed-a04c0954d31c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:33.499082 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d7c064fb-e2a1-4c97-88ed-a04c0954d31c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:33.499566 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d7c064fb-e2a1-4c97-88ed-a04c0954d31c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:33.630486 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d7c064fb-e2a1-4c97-88ed-a04c0954d31c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:33.639675 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d7c064fb-e2a1-4c97-88ed-a04c0954d31c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:33.641251 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d7c064fb-e2a1-4c97-88ed-a04c0954d31c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:33.642452 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d7c064fb-e2a1-4c97-88ed-a04c0954d31c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1810 microversion: 2.20 time: 0.156247 May 28 17:31:33.643055 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 372/731] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:33 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:31:33.724387 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a9738c96-aa23-4762-8fca-28674ef5affd tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:31:33.730760 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a9738c96-aa23-4762-8fca-28674ef5affd tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:33.731156 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a9738c96-aa23-4762-8fca-28674ef5affd tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:33.753156 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a9738c96-aa23-4762-8fca-28674ef5affd tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Going to try to stop instance {{(pid=117605) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 28 17:31:33.794254 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a9738c96-aa23-4762-8fca-28674ef5affd tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "POST /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512/action" status: 202 len: 0 microversion: 2.1 time: 0.073640 May 28 17:31:33.794843 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 360/732] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 17:31:33 2022] POST /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 17:31:33.802857 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ba7569af-1fd6-49f7-a588-7fa8d5d99d84 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:33.803520 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ba7569af-1fd6-49f7-a588-7fa8d5d99d84 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:33.810157 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ba7569af-1fd6-49f7-a588-7fa8d5d99d84 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:33.810601 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ba7569af-1fd6-49f7-a588-7fa8d5d99d84 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:33.811361 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ba7569af-1fd6-49f7-a588-7fa8d5d99d84 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:33.811807 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ba7569af-1fd6-49f7-a588-7fa8d5d99d84 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:33.942654 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ba7569af-1fd6-49f7-a588-7fa8d5d99d84 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:33.944997 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:31:33.952392 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ba7569af-1fd6-49f7-a588-7fa8d5d99d84 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1676 microversion: 2.1 time: 0.153384 May 28 17:31:33.952957 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 373/733] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:33 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:34.250456 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9ee2f587-4323-4d8d-8e57-19ed7d7b687d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:34.251155 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9ee2f587-4323-4d8d-8e57-19ed7d7b687d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:34.258332 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9ee2f587-4323-4d8d-8e57-19ed7d7b687d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:34.258787 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9ee2f587-4323-4d8d-8e57-19ed7d7b687d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:34.259588 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9ee2f587-4323-4d8d-8e57-19ed7d7b687d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:34.260024 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9ee2f587-4323-4d8d-8e57-19ed7d7b687d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:34.393652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d7d7a29c-8194-4fc7-bc17-3cd686cb885b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:34.394206 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d7d7a29c-8194-4fc7-bc17-3cd686cb885b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:34.397475 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-9ee2f587-4323-4d8d-8e57-19ed7d7b687d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:34.401082 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d7d7a29c-8194-4fc7-bc17-3cd686cb885b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:34.401538 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d7d7a29c-8194-4fc7-bc17-3cd686cb885b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:34.402310 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d7d7a29c-8194-4fc7-bc17-3cd686cb885b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:34.402746 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d7d7a29c-8194-4fc7-bc17-3cd686cb885b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:34.406000 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9ee2f587-4323-4d8d-8e57-19ed7d7b687d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1734 microversion: 2.1 time: 0.159886 May 28 17:31:34.406606 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 361/734] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:34 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:34.537883 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d7d7a29c-8194-4fc7-bc17-3cd686cb885b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:34.545590 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d7d7a29c-8194-4fc7-bc17-3cd686cb885b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1261 microversion: 2.1 time: 0.156444 May 28 17:31:34.546147 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 374/735] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:34 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:31:34.660595 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-91b041ef-b009-4a81-9576-ccdc61b82da9 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:34.661362 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-91b041ef-b009-4a81-9576-ccdc61b82da9 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:34.667826 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-91b041ef-b009-4a81-9576-ccdc61b82da9 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:34.668279 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-91b041ef-b009-4a81-9576-ccdc61b82da9 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:34.669043 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-91b041ef-b009-4a81-9576-ccdc61b82da9 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:34.669482 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-91b041ef-b009-4a81-9576-ccdc61b82da9 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:34.814574 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-91b041ef-b009-4a81-9576-ccdc61b82da9 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:34.823947 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-91b041ef-b009-4a81-9576-ccdc61b82da9 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:34.825358 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-91b041ef-b009-4a81-9576-ccdc61b82da9 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:34.826531 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-91b041ef-b009-4a81-9576-ccdc61b82da9 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1810 microversion: 2.20 time: 0.169832 May 28 17:31:34.827087 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 362/736] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:34 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:31:34.969620 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9593eba2-11c4-492a-ba1e-f7b54bcab662 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:34.970235 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9593eba2-11c4-492a-ba1e-f7b54bcab662 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:34.976900 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9593eba2-11c4-492a-ba1e-f7b54bcab662 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:34.977523 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9593eba2-11c4-492a-ba1e-f7b54bcab662 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:34.978679 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9593eba2-11c4-492a-ba1e-f7b54bcab662 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:34.979119 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9593eba2-11c4-492a-ba1e-f7b54bcab662 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:35.114381 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9593eba2-11c4-492a-ba1e-f7b54bcab662 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:35.121930 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9593eba2-11c4-492a-ba1e-f7b54bcab662 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1676 microversion: 2.1 time: 0.156200 May 28 17:31:35.122487 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 375/737] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:34 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:31:35.423948 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-46e48f5c-2f17-41d2-88bd-13234a5816fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:35.424530 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-46e48f5c-2f17-41d2-88bd-13234a5816fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:35.431482 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-46e48f5c-2f17-41d2-88bd-13234a5816fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:35.431939 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-46e48f5c-2f17-41d2-88bd-13234a5816fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:35.432714 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-46e48f5c-2f17-41d2-88bd-13234a5816fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:35.433155 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-46e48f5c-2f17-41d2-88bd-13234a5816fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:35.448807 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:31:35.562530 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d6152a1d-fbb5-4827-8ef8-e521ee5b0b9c tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:35.563144 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d6152a1d-fbb5-4827-8ef8-e521ee5b0b9c tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:35.570174 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d6152a1d-fbb5-4827-8ef8-e521ee5b0b9c tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:35.570716 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d6152a1d-fbb5-4827-8ef8-e521ee5b0b9c tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:35.571528 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d6152a1d-fbb5-4827-8ef8-e521ee5b0b9c tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:35.571696 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-46e48f5c-2f17-41d2-88bd-13234a5816fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:35.571964 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d6152a1d-fbb5-4827-8ef8-e521ee5b0b9c tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:35.579644 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-46e48f5c-2f17-41d2-88bd-13234a5816fc tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1734 microversion: 2.1 time: 0.159526 May 28 17:31:35.580200 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 363/738] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:35 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:35.702824 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d6152a1d-fbb5-4827-8ef8-e521ee5b0b9c tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:35.710188 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d6152a1d-fbb5-4827-8ef8-e521ee5b0b9c tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1261 microversion: 2.1 time: 0.151591 May 28 17:31:35.711349 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 376/739] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:35 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:35.844877 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8d9b6e23-4142-49aa-9469-55ba2b77097e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:35.845487 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8d9b6e23-4142-49aa-9469-55ba2b77097e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:35.851600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8d9b6e23-4142-49aa-9469-55ba2b77097e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:35.852047 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8d9b6e23-4142-49aa-9469-55ba2b77097e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:35.852827 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8d9b6e23-4142-49aa-9469-55ba2b77097e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:35.853265 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8d9b6e23-4142-49aa-9469-55ba2b77097e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:35.979824 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8d9b6e23-4142-49aa-9469-55ba2b77097e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:35.988106 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8d9b6e23-4142-49aa-9469-55ba2b77097e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:35.989598 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8d9b6e23-4142-49aa-9469-55ba2b77097e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:35.990755 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8d9b6e23-4142-49aa-9469-55ba2b77097e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1797 microversion: 2.20 time: 0.149757 May 28 17:31:35.991309 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 364/740] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:31:35 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1797 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:31:36.140667 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-442e6b50-834d-4c9d-a123-aed024397a18 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:36.141488 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-442e6b50-834d-4c9d-a123-aed024397a18 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:36.148724 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-442e6b50-834d-4c9d-a123-aed024397a18 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:36.149530 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-442e6b50-834d-4c9d-a123-aed024397a18 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:36.150528 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-442e6b50-834d-4c9d-a123-aed024397a18 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:36.150974 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-442e6b50-834d-4c9d-a123-aed024397a18 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:36.277169 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-442e6b50-834d-4c9d-a123-aed024397a18 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:36.284685 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-442e6b50-834d-4c9d-a123-aed024397a18 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1676 microversion: 2.1 time: 0.149098 May 28 17:31:36.285244 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 377/741] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:36 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:36.597559 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1468e617-9707-4296-8f75-19128b156d74 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:36.598079 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1468e617-9707-4296-8f75-19128b156d74 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:36.605942 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1468e617-9707-4296-8f75-19128b156d74 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:36.606432 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1468e617-9707-4296-8f75-19128b156d74 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:36.607188 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1468e617-9707-4296-8f75-19128b156d74 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:36.607654 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1468e617-9707-4296-8f75-19128b156d74 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:36.728186 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-cc87c5e6-5a4e-4d98-9fd2-13c8682eae9f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:36.728883 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-cc87c5e6-5a4e-4d98-9fd2-13c8682eae9f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:36.736158 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cc87c5e6-5a4e-4d98-9fd2-13c8682eae9f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:36.736610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cc87c5e6-5a4e-4d98-9fd2-13c8682eae9f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:36.737382 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cc87c5e6-5a4e-4d98-9fd2-13c8682eae9f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:36.737819 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cc87c5e6-5a4e-4d98-9fd2-13c8682eae9f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:36.741054 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1468e617-9707-4296-8f75-19128b156d74 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:36.749091 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1468e617-9707-4296-8f75-19128b156d74 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1734 microversion: 2.1 time: 0.155429 May 28 17:31:36.749740 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 365/742] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:36 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:36.870115 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-cc87c5e6-5a4e-4d98-9fd2-13c8682eae9f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:36.878265 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-cc87c5e6-5a4e-4d98-9fd2-13c8682eae9f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1261 microversion: 2.1 time: 0.154393 May 28 17:31:36.878860 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 378/743] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:36 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:31:37.302617 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3d954750-4bc5-4df4-a7a3-be63b1595477 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:37.303226 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3d954750-4bc5-4df4-a7a3-be63b1595477 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:37.309842 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3d954750-4bc5-4df4-a7a3-be63b1595477 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:37.310287 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3d954750-4bc5-4df4-a7a3-be63b1595477 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:37.311031 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3d954750-4bc5-4df4-a7a3-be63b1595477 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:37.311492 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3d954750-4bc5-4df4-a7a3-be63b1595477 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:37.439495 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3d954750-4bc5-4df4-a7a3-be63b1595477 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:37.447072 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3d954750-4bc5-4df4-a7a3-be63b1595477 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1676 microversion: 2.1 time: 0.148266 May 28 17:31:37.447662 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 366/744] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:37 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:37.765885 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b28beab4-2017-419d-8ba0-0d30b06fd51d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:37.766500 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b28beab4-2017-419d-8ba0-0d30b06fd51d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:37.773696 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b28beab4-2017-419d-8ba0-0d30b06fd51d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:37.774335 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b28beab4-2017-419d-8ba0-0d30b06fd51d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:37.775176 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b28beab4-2017-419d-8ba0-0d30b06fd51d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:37.775646 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b28beab4-2017-419d-8ba0-0d30b06fd51d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:37.897645 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c9fe1ce3-10db-4d32-9513-20260730e5f4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:37.899182 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c9fe1ce3-10db-4d32-9513-20260730e5f4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:37.908734 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c9fe1ce3-10db-4d32-9513-20260730e5f4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:37.909426 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c9fe1ce3-10db-4d32-9513-20260730e5f4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:37.910617 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c9fe1ce3-10db-4d32-9513-20260730e5f4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:37.911289 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c9fe1ce3-10db-4d32-9513-20260730e5f4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:37.911430 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b28beab4-2017-419d-8ba0-0d30b06fd51d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:37.919877 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b28beab4-2017-419d-8ba0-0d30b06fd51d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1734 microversion: 2.1 time: 0.157837 May 28 17:31:37.920533 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 379/745] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:37 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:38.050954 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c9fe1ce3-10db-4d32-9513-20260730e5f4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:38.059123 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c9fe1ce3-10db-4d32-9513-20260730e5f4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1261 microversion: 2.1 time: 0.167807 May 28 17:31:38.059734 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 367/746] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:37 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:38.464288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e4aebce9-343f-4ad2-a3bf-35ae8956b02d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:38.464935 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e4aebce9-343f-4ad2-a3bf-35ae8956b02d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:38.470952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e4aebce9-343f-4ad2-a3bf-35ae8956b02d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:38.471442 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e4aebce9-343f-4ad2-a3bf-35ae8956b02d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:38.472205 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e4aebce9-343f-4ad2-a3bf-35ae8956b02d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:38.472644 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e4aebce9-343f-4ad2-a3bf-35ae8956b02d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:38.607052 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e4aebce9-343f-4ad2-a3bf-35ae8956b02d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:38.614456 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e4aebce9-343f-4ad2-a3bf-35ae8956b02d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1676 microversion: 2.1 time: 0.154349 May 28 17:31:38.615008 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 380/747] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:38 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:38.937266 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-904bc602-dbe9-4456-9e83-8d48229bf2de tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:38.937873 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-904bc602-dbe9-4456-9e83-8d48229bf2de tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:38.944272 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-904bc602-dbe9-4456-9e83-8d48229bf2de tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:38.945165 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-904bc602-dbe9-4456-9e83-8d48229bf2de tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:38.945925 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-904bc602-dbe9-4456-9e83-8d48229bf2de tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:38.946360 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-904bc602-dbe9-4456-9e83-8d48229bf2de tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:39.072214 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-904bc602-dbe9-4456-9e83-8d48229bf2de tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:39.074968 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b3c0e0c0-dd1a-4b43-ba3f-9cdea8b63608 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:39.075608 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b3c0e0c0-dd1a-4b43-ba3f-9cdea8b63608 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:39.080208 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-904bc602-dbe9-4456-9e83-8d48229bf2de tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1734 microversion: 2.1 time: 0.147007 May 28 17:31:39.080860 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 368/748] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:38 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:39.082056 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b3c0e0c0-dd1a-4b43-ba3f-9cdea8b63608 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:39.082513 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b3c0e0c0-dd1a-4b43-ba3f-9cdea8b63608 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:39.083278 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b3c0e0c0-dd1a-4b43-ba3f-9cdea8b63608 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:39.083741 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b3c0e0c0-dd1a-4b43-ba3f-9cdea8b63608 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:39.214191 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b3c0e0c0-dd1a-4b43-ba3f-9cdea8b63608 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:39.221595 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b3c0e0c0-dd1a-4b43-ba3f-9cdea8b63608 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1261 microversion: 2.1 time: 0.150440 May 28 17:31:39.222360 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 381/749] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:39 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:31:39.634038 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ab4237b0-6238-496d-860b-d25dc39ea0d1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:39.634562 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ab4237b0-6238-496d-860b-d25dc39ea0d1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:39.640601 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ab4237b0-6238-496d-860b-d25dc39ea0d1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:39.641055 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ab4237b0-6238-496d-860b-d25dc39ea0d1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:39.641820 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ab4237b0-6238-496d-860b-d25dc39ea0d1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:39.642281 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ab4237b0-6238-496d-860b-d25dc39ea0d1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:39.777803 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ab4237b0-6238-496d-860b-d25dc39ea0d1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:39.785193 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ab4237b0-6238-496d-860b-d25dc39ea0d1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1676 microversion: 2.1 time: 0.155758 May 28 17:31:39.785763 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 369/750] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:39 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:40.097435 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d1af3b94-b71d-475a-9100-7754dcf094fd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:40.098166 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d1af3b94-b71d-475a-9100-7754dcf094fd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:40.105585 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d1af3b94-b71d-475a-9100-7754dcf094fd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:40.106037 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d1af3b94-b71d-475a-9100-7754dcf094fd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:40.106829 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d1af3b94-b71d-475a-9100-7754dcf094fd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:40.107262 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d1af3b94-b71d-475a-9100-7754dcf094fd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:40.238069 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ff584ce4-484b-4302-bf77-153567c52459 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:40.238729 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ff584ce4-484b-4302-bf77-153567c52459 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:40.240913 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d1af3b94-b71d-475a-9100-7754dcf094fd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:40.246269 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ff584ce4-484b-4302-bf77-153567c52459 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:40.246788 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ff584ce4-484b-4302-bf77-153567c52459 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:40.247588 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ff584ce4-484b-4302-bf77-153567c52459 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:40.248030 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ff584ce4-484b-4302-bf77-153567c52459 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:40.249404 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d1af3b94-b71d-475a-9100-7754dcf094fd tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1734 microversion: 2.1 time: 0.155822 May 28 17:31:40.249973 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 382/751] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:40 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:40.378064 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ff584ce4-484b-4302-bf77-153567c52459 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:40.386102 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ff584ce4-484b-4302-bf77-153567c52459 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1261 microversion: 2.1 time: 0.151956 May 28 17:31:40.386654 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 370/752] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:40 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:31:40.802670 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-01109627-ccbc-493b-8982-47e94cc73965 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:40.803287 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-01109627-ccbc-493b-8982-47e94cc73965 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:40.809454 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-01109627-ccbc-493b-8982-47e94cc73965 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:40.809904 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-01109627-ccbc-493b-8982-47e94cc73965 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:40.810666 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-01109627-ccbc-493b-8982-47e94cc73965 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:40.811104 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-01109627-ccbc-493b-8982-47e94cc73965 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:40.940286 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-01109627-ccbc-493b-8982-47e94cc73965 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:40.948412 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-01109627-ccbc-493b-8982-47e94cc73965 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1676 microversion: 2.1 time: 0.149618 May 28 17:31:40.948970 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 383/753] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:40 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:41.268197 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1241fb22-9e89-40f1-9048-8a07b7bb0479 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:41.268812 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1241fb22-9e89-40f1-9048-8a07b7bb0479 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:41.275892 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1241fb22-9e89-40f1-9048-8a07b7bb0479 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:41.276340 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1241fb22-9e89-40f1-9048-8a07b7bb0479 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:41.277092 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1241fb22-9e89-40f1-9048-8a07b7bb0479 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:41.277522 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1241fb22-9e89-40f1-9048-8a07b7bb0479 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:41.402598 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0904a1d3-caeb-4c51-b349-ea0ee6585057 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:41.403214 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0904a1d3-caeb-4c51-b349-ea0ee6585057 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:41.409343 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1241fb22-9e89-40f1-9048-8a07b7bb0479 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:41.410746 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0904a1d3-caeb-4c51-b349-ea0ee6585057 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:41.411207 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0904a1d3-caeb-4c51-b349-ea0ee6585057 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:41.412026 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0904a1d3-caeb-4c51-b349-ea0ee6585057 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:41.412467 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0904a1d3-caeb-4c51-b349-ea0ee6585057 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:41.418987 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1241fb22-9e89-40f1-9048-8a07b7bb0479 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1734 microversion: 2.1 time: 0.155375 May 28 17:31:41.419741 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 371/754] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:41 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:41.507408 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-d95f8dfd-607e-4b7b-ad11-ec4ebb81b89a req-f8671072-1acb-47d3-93d0-e5684fce258c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "281e6309-8591-49e7-ab2a-e36aa0fad594", "name": "network-vif-plugged", "status": "completed", "tag": "50d0ffcf-e908-48f5-9b29-2b70709081b6"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:31:41.515988 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-d95f8dfd-607e-4b7b-ad11-ec4ebb81b89a req-f8671072-1acb-47d3-93d0-e5684fce258c service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:41.516454 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-d95f8dfd-607e-4b7b-ad11-ec4ebb81b89a req-f8671072-1acb-47d3-93d0-e5684fce258c service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:41.527940 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-d95f8dfd-607e-4b7b-ad11-ec4ebb81b89a req-f8671072-1acb-47d3-93d0-e5684fce258c service nova] Creating event network-vif-plugged:50d0ffcf-e908-48f5-9b29-2b70709081b6 for instance 281e6309-8591-49e7-ab2a-e36aa0fad594 on hv-cinder-84372 May 28 17:31:41.532915 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-d95f8dfd-607e-4b7b-ad11-ec4ebb81b89a req-f8671072-1acb-47d3-93d0-e5684fce258c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029161 May 28 17:31:41.533531 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 372/755] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:31:41.555317 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0904a1d3-caeb-4c51-b349-ea0ee6585057 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:41.564571 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0904a1d3-caeb-4c51-b349-ea0ee6585057 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1261 microversion: 2.1 time: 0.166378 May 28 17:31:41.565153 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 384/756] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:41 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:31:41.966154 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-aa78ba76-a20f-42a9-8306-6e2ed45a63df tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:41.966845 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-aa78ba76-a20f-42a9-8306-6e2ed45a63df tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:41.972955 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-aa78ba76-a20f-42a9-8306-6e2ed45a63df tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:41.973403 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-aa78ba76-a20f-42a9-8306-6e2ed45a63df tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:41.974155 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-aa78ba76-a20f-42a9-8306-6e2ed45a63df tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:41.974588 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-aa78ba76-a20f-42a9-8306-6e2ed45a63df tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:42.100980 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-aa78ba76-a20f-42a9-8306-6e2ed45a63df tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:42.109070 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-aa78ba76-a20f-42a9-8306-6e2ed45a63df tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1676 microversion: 2.1 time: 0.147128 May 28 17:31:42.109640 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 373/757] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:41 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:42.436579 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8f6a5bb4-8797-471b-ab5d-d23e80266957 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:42.437210 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8f6a5bb4-8797-471b-ab5d-d23e80266957 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:42.443709 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8f6a5bb4-8797-471b-ab5d-d23e80266957 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:42.444164 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8f6a5bb4-8797-471b-ab5d-d23e80266957 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:42.445439 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8f6a5bb4-8797-471b-ab5d-d23e80266957 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:42.446037 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8f6a5bb4-8797-471b-ab5d-d23e80266957 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:42.581469 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6113c913-25f7-4172-8698-80bb79674289 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:42.581994 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8f6a5bb4-8797-471b-ab5d-d23e80266957 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:42.582116 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6113c913-25f7-4172-8698-80bb79674289 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:42.588592 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6113c913-25f7-4172-8698-80bb79674289 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:42.589528 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6113c913-25f7-4172-8698-80bb79674289 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:42.590363 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6113c913-25f7-4172-8698-80bb79674289 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:42.590797 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6113c913-25f7-4172-8698-80bb79674289 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:42.591392 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8f6a5bb4-8797-471b-ab5d-d23e80266957 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1734 microversion: 2.1 time: 0.158997 May 28 17:31:42.591960 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 385/758] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:42 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:42.724131 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-6113c913-25f7-4172-8698-80bb79674289 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:42.731712 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6113c913-25f7-4172-8698-80bb79674289 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1261 microversion: 2.1 time: 0.154458 May 28 17:31:42.732283 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 374/759] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:42 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:31:43.125311 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1c2e7277-c4d0-4af6-89a3-18821c0c95f8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:43.125924 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1c2e7277-c4d0-4af6-89a3-18821c0c95f8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:43.132246 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c2e7277-c4d0-4af6-89a3-18821c0c95f8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:43.133109 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c2e7277-c4d0-4af6-89a3-18821c0c95f8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:43.133652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c2e7277-c4d0-4af6-89a3-18821c0c95f8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:43.134084 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c2e7277-c4d0-4af6-89a3-18821c0c95f8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:43.265056 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1c2e7277-c4d0-4af6-89a3-18821c0c95f8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:43.272541 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1c2e7277-c4d0-4af6-89a3-18821c0c95f8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1676 microversion: 2.1 time: 0.151057 May 28 17:31:43.273652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 386/760] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:43 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:43.608550 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-20344186-1772-4423-afda-ad03db2b9ae7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:43.609156 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-20344186-1772-4423-afda-ad03db2b9ae7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:43.615672 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-20344186-1772-4423-afda-ad03db2b9ae7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:43.616122 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-20344186-1772-4423-afda-ad03db2b9ae7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:43.617447 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-20344186-1772-4423-afda-ad03db2b9ae7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:43.618144 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-20344186-1772-4423-afda-ad03db2b9ae7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:43.748039 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-20344186-1772-4423-afda-ad03db2b9ae7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:43.749223 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-bf80cba6-c798-4f41-bd8f-aefd2fd7e9b4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:43.749840 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-bf80cba6-c798-4f41-bd8f-aefd2fd7e9b4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:43.756300 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-20344186-1772-4423-afda-ad03db2b9ae7 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1734 microversion: 2.1 time: 0.151661 May 28 17:31:43.756865 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 375/761] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:43 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:43.756982 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bf80cba6-c798-4f41-bd8f-aefd2fd7e9b4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:43.757442 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bf80cba6-c798-4f41-bd8f-aefd2fd7e9b4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:43.758414 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bf80cba6-c798-4f41-bd8f-aefd2fd7e9b4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:43.758899 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bf80cba6-c798-4f41-bd8f-aefd2fd7e9b4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:43.899498 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-bf80cba6-c798-4f41-bd8f-aefd2fd7e9b4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:43.906972 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-bf80cba6-c798-4f41-bd8f-aefd2fd7e9b4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1446 microversion: 2.1 time: 0.161623 May 28 17:31:43.907563 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 387/762] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:43 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1446 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:31:43.923216 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f5297fec-66ab-4d86-9587-1c963f2f1d98 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:43.923887 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f5297fec-66ab-4d86-9587-1c963f2f1d98 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:43.930515 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f5297fec-66ab-4d86-9587-1c963f2f1d98 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:43.930966 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f5297fec-66ab-4d86-9587-1c963f2f1d98 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:43.931769 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f5297fec-66ab-4d86-9587-1c963f2f1d98 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:43.932201 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f5297fec-66ab-4d86-9587-1c963f2f1d98 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:44.062217 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f5297fec-66ab-4d86-9587-1c963f2f1d98 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:44.069614 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f5297fec-66ab-4d86-9587-1c963f2f1d98 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1446 microversion: 2.1 time: 0.150198 May 28 17:31:44.070176 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 376/763] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:43 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1446 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:44.291071 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-189e2fcb-33f3-40fc-af1f-8a13adaf7c3e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:44.291728 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-189e2fcb-33f3-40fc-af1f-8a13adaf7c3e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:44.297631 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-189e2fcb-33f3-40fc-af1f-8a13adaf7c3e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:44.298078 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-189e2fcb-33f3-40fc-af1f-8a13adaf7c3e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:44.298868 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-189e2fcb-33f3-40fc-af1f-8a13adaf7c3e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:44.299308 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-189e2fcb-33f3-40fc-af1f-8a13adaf7c3e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:44.430230 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-189e2fcb-33f3-40fc-af1f-8a13adaf7c3e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:44.437726 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-189e2fcb-33f3-40fc-af1f-8a13adaf7c3e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1676 microversion: 2.1 time: 0.151165 May 28 17:31:44.438536 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 388/764] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:44 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:44.774384 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d1eb1e59-bc2b-40a1-8ebc-fad92542175c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:44.774993 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d1eb1e59-bc2b-40a1-8ebc-fad92542175c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:44.781486 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d1eb1e59-bc2b-40a1-8ebc-fad92542175c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:44.781930 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d1eb1e59-bc2b-40a1-8ebc-fad92542175c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:44.782694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d1eb1e59-bc2b-40a1-8ebc-fad92542175c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:44.783182 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d1eb1e59-bc2b-40a1-8ebc-fad92542175c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:45.021421 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d1eb1e59-bc2b-40a1-8ebc-fad92542175c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:45.029552 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d1eb1e59-bc2b-40a1-8ebc-fad92542175c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1734 microversion: 2.1 time: 0.259668 May 28 17:31:45.030125 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 377/765] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:44 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1734 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:45.456265 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d6cbf7d9-2d53-475d-a0f7-fa717aaa4d5d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:45.456886 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d6cbf7d9-2d53-475d-a0f7-fa717aaa4d5d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:45.464438 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d6cbf7d9-2d53-475d-a0f7-fa717aaa4d5d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:45.464885 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d6cbf7d9-2d53-475d-a0f7-fa717aaa4d5d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:45.465654 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d6cbf7d9-2d53-475d-a0f7-fa717aaa4d5d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:45.466088 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d6cbf7d9-2d53-475d-a0f7-fa717aaa4d5d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:45.602692 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d6cbf7d9-2d53-475d-a0f7-fa717aaa4d5d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:45.610272 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d6cbf7d9-2d53-475d-a0f7-fa717aaa4d5d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1676 microversion: 2.1 time: 0.158063 May 28 17:31:45.611060 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 389/766] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:45 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:46.046735 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6d4d402e-cb37-4117-8e7d-4855faf1425f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:46.047684 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6d4d402e-cb37-4117-8e7d-4855faf1425f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:46.054109 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6d4d402e-cb37-4117-8e7d-4855faf1425f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:46.054685 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6d4d402e-cb37-4117-8e7d-4855faf1425f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:46.055517 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6d4d402e-cb37-4117-8e7d-4855faf1425f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:46.055959 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6d4d402e-cb37-4117-8e7d-4855faf1425f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:46.072872 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=100 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:31:46.096726 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-2f868105-70d2-46bf-8b92-dec24b72c26f req-58db77b8-e50e-46ef-ad3f-724286094f35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "281e6309-8591-49e7-ab2a-e36aa0fad594", "tag": "50d0ffcf-e908-48f5-9b29-2b70709081b6"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:31:46.105171 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-2f868105-70d2-46bf-8b92-dec24b72c26f req-58db77b8-e50e-46ef-ad3f-724286094f35 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:46.105613 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-2f868105-70d2-46bf-8b92-dec24b72c26f req-58db77b8-e50e-46ef-ad3f-724286094f35 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:46.116783 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-2f868105-70d2-46bf-8b92-dec24b72c26f req-58db77b8-e50e-46ef-ad3f-724286094f35 service nova] Creating event network-changed:50d0ffcf-e908-48f5-9b29-2b70709081b6 for instance 281e6309-8591-49e7-ab2a-e36aa0fad594 on hv-cinder-84372 May 28 17:31:46.122110 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-2f868105-70d2-46bf-8b92-dec24b72c26f req-58db77b8-e50e-46ef-ad3f-724286094f35 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088773 May 28 17:31:46.122743 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 378/767] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:31:46.201055 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6d4d402e-cb37-4117-8e7d-4855faf1425f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:46.210009 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6d4d402e-cb37-4117-8e7d-4855faf1425f tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1734 microversion: 2.1 time: 0.167340 May 28 17:31:46.212590 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 390/768] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:46 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:31:46.628218 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7655a7e2-9949-4143-99ab-e5673f6f6a33 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:46.628927 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7655a7e2-9949-4143-99ab-e5673f6f6a33 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:46.635737 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7655a7e2-9949-4143-99ab-e5673f6f6a33 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:46.636194 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7655a7e2-9949-4143-99ab-e5673f6f6a33 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:46.637022 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7655a7e2-9949-4143-99ab-e5673f6f6a33 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:46.637407 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7655a7e2-9949-4143-99ab-e5673f6f6a33 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:46.780906 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7655a7e2-9949-4143-99ab-e5673f6f6a33 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:46.789319 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7655a7e2-9949-4143-99ab-e5673f6f6a33 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1676 microversion: 2.1 time: 0.165075 May 28 17:31:46.789888 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 379/769] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:46 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:47.228997 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-fb0cf12a-a76d-4179-bab4-510de3ec025d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:47.229608 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-fb0cf12a-a76d-4179-bab4-510de3ec025d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:47.237126 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fb0cf12a-a76d-4179-bab4-510de3ec025d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:47.237577 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fb0cf12a-a76d-4179-bab4-510de3ec025d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:47.238341 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fb0cf12a-a76d-4179-bab4-510de3ec025d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:47.238778 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fb0cf12a-a76d-4179-bab4-510de3ec025d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:47.366135 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-fb0cf12a-a76d-4179-bab4-510de3ec025d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:47.374294 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-fb0cf12a-a76d-4179-bab4-510de3ec025d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1734 microversion: 2.1 time: 0.149252 May 28 17:31:47.374865 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 391/770] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:47 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:47.807717 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-28e8064c-0515-4f57-a270-89800a8a64f7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:47.808300 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-28e8064c-0515-4f57-a270-89800a8a64f7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:47.814717 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-28e8064c-0515-4f57-a270-89800a8a64f7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:47.815161 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-28e8064c-0515-4f57-a270-89800a8a64f7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:47.815941 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-28e8064c-0515-4f57-a270-89800a8a64f7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:47.816375 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-28e8064c-0515-4f57-a270-89800a8a64f7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:47.948934 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-28e8064c-0515-4f57-a270-89800a8a64f7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:47.956240 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-28e8064c-0515-4f57-a270-89800a8a64f7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1676 microversion: 2.1 time: 0.153033 May 28 17:31:47.956797 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 380/771] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:47 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:48.391672 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6be30ed5-6ee1-40e6-b49e-e6bef0b9fe15 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:48.392289 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6be30ed5-6ee1-40e6-b49e-e6bef0b9fe15 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:48.398854 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6be30ed5-6ee1-40e6-b49e-e6bef0b9fe15 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:48.399303 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6be30ed5-6ee1-40e6-b49e-e6bef0b9fe15 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:48.400098 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6be30ed5-6ee1-40e6-b49e-e6bef0b9fe15 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:48.400539 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6be30ed5-6ee1-40e6-b49e-e6bef0b9fe15 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:48.536210 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6be30ed5-6ee1-40e6-b49e-e6bef0b9fe15 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:48.544811 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6be30ed5-6ee1-40e6-b49e-e6bef0b9fe15 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1734 microversion: 2.1 time: 0.157068 May 28 17:31:48.545373 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 392/772] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:48 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:48.973157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-13a71834-60f3-4fd8-9ef9-1b8412485b94 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:48.973715 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-13a71834-60f3-4fd8-9ef9-1b8412485b94 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:48.980156 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-13a71834-60f3-4fd8-9ef9-1b8412485b94 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:48.980608 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-13a71834-60f3-4fd8-9ef9-1b8412485b94 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:48.981372 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-13a71834-60f3-4fd8-9ef9-1b8412485b94 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:48.982011 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-13a71834-60f3-4fd8-9ef9-1b8412485b94 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:48.997075 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=100 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:31:49.118154 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-13a71834-60f3-4fd8-9ef9-1b8412485b94 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:49.125531 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-13a71834-60f3-4fd8-9ef9-1b8412485b94 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1676 microversion: 2.1 time: 0.156335 May 28 17:31:49.126100 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 381/773] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:48 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:49.563253 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-39be149e-41ba-491c-96b6-114de502d6c5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:49.563853 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-39be149e-41ba-491c-96b6-114de502d6c5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:49.570708 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-39be149e-41ba-491c-96b6-114de502d6c5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:49.571259 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-39be149e-41ba-491c-96b6-114de502d6c5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:49.572060 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-39be149e-41ba-491c-96b6-114de502d6c5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:49.572501 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-39be149e-41ba-491c-96b6-114de502d6c5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:49.709841 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-39be149e-41ba-491c-96b6-114de502d6c5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:49.717989 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-39be149e-41ba-491c-96b6-114de502d6c5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1734 microversion: 2.1 time: 0.159886 May 28 17:31:49.718556 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 393/774] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:49 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:50.143456 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5b9be593-a9d6-442d-9e98-4ab22f1d65e4 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:50.146829 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5b9be593-a9d6-442d-9e98-4ab22f1d65e4 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:50.151934 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5b9be593-a9d6-442d-9e98-4ab22f1d65e4 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:50.152375 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5b9be593-a9d6-442d-9e98-4ab22f1d65e4 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:50.153128 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5b9be593-a9d6-442d-9e98-4ab22f1d65e4 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:50.153560 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5b9be593-a9d6-442d-9e98-4ab22f1d65e4 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:50.282789 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5b9be593-a9d6-442d-9e98-4ab22f1d65e4 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:50.291044 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5b9be593-a9d6-442d-9e98-4ab22f1d65e4 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1653 microversion: 2.1 time: 0.151620 May 28 17:31:50.291652 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 382/775] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:50 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1653 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:50.308115 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1e335077-4c8c-4e98-be70-4e4dd3edd551 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:31:50.314357 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1e335077-4c8c-4e98-be70-4e4dd3edd551 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:50.314808 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1e335077-4c8c-4e98-be70-4e4dd3edd551 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:50.336516 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1e335077-4c8c-4e98-be70-4e4dd3edd551 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Going to try to start instance {{(pid=117604) start /opt/stack/nova/nova/compute/api.py:2730}} May 28 17:31:50.379130 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1e335077-4c8c-4e98-be70-4e4dd3edd551 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "POST /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512/action" status: 202 len: 0 microversion: 2.1 time: 0.075758 May 28 17:31:50.379746 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 394/776] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 17:31:50 2022] POST /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 17:31:50.387916 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c9aa4c5d-08b2-421c-ae44-6c436c9a57bc tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:50.388572 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c9aa4c5d-08b2-421c-ae44-6c436c9a57bc tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:50.394608 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c9aa4c5d-08b2-421c-ae44-6c436c9a57bc tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:50.395003 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c9aa4c5d-08b2-421c-ae44-6c436c9a57bc tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:50.395796 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c9aa4c5d-08b2-421c-ae44-6c436c9a57bc tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:50.396236 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c9aa4c5d-08b2-421c-ae44-6c436c9a57bc tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:50.525037 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c9aa4c5d-08b2-421c-ae44-6c436c9a57bc tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:50.532694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c9aa4c5d-08b2-421c-ae44-6c436c9a57bc tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1662 microversion: 2.1 time: 0.148565 May 28 17:31:50.533257 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 383/777] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:50 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1662 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:31:50.735330 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1b55e04d-4658-466c-a834-b06ec8d7414b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:50.736053 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1b55e04d-4658-466c-a834-b06ec8d7414b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:50.742753 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1b55e04d-4658-466c-a834-b06ec8d7414b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:50.743199 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1b55e04d-4658-466c-a834-b06ec8d7414b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:50.743985 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1b55e04d-4658-466c-a834-b06ec8d7414b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:50.744421 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1b55e04d-4658-466c-a834-b06ec8d7414b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:50.875388 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1b55e04d-4658-466c-a834-b06ec8d7414b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:50.884424 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1b55e04d-4658-466c-a834-b06ec8d7414b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1734 microversion: 2.1 time: 0.153300 May 28 17:31:50.885001 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 395/778] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:50 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:51.550124 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f70756d8-c24d-48a0-bd0b-e69686a80ae2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:51.550739 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f70756d8-c24d-48a0-bd0b-e69686a80ae2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:51.557688 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f70756d8-c24d-48a0-bd0b-e69686a80ae2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:51.558133 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f70756d8-c24d-48a0-bd0b-e69686a80ae2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:51.558955 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f70756d8-c24d-48a0-bd0b-e69686a80ae2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:51.559429 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f70756d8-c24d-48a0-bd0b-e69686a80ae2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:51.694411 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f70756d8-c24d-48a0-bd0b-e69686a80ae2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:51.702183 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f70756d8-c24d-48a0-bd0b-e69686a80ae2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1662 microversion: 2.1 time: 0.155999 May 28 17:31:51.702751 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 384/779] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:51 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1662 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:51.902968 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b926a6ff-e04e-4fec-be5b-efb2b51b1579 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:51.903623 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b926a6ff-e04e-4fec-be5b-efb2b51b1579 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:51.910014 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b926a6ff-e04e-4fec-be5b-efb2b51b1579 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:51.910455 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b926a6ff-e04e-4fec-be5b-efb2b51b1579 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:51.911208 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b926a6ff-e04e-4fec-be5b-efb2b51b1579 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:51.911673 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b926a6ff-e04e-4fec-be5b-efb2b51b1579 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:52.039713 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b926a6ff-e04e-4fec-be5b-efb2b51b1579 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:52.047565 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b926a6ff-e04e-4fec-be5b-efb2b51b1579 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1734 microversion: 2.1 time: 0.149553 May 28 17:31:52.048120 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 396/780] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:51 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:52.720398 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a28d37ab-52b3-495a-b099-5065984b61d1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:52.721112 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a28d37ab-52b3-495a-b099-5065984b61d1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:52.729374 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a28d37ab-52b3-495a-b099-5065984b61d1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:52.729822 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a28d37ab-52b3-495a-b099-5065984b61d1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:52.730580 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a28d37ab-52b3-495a-b099-5065984b61d1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:52.731013 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a28d37ab-52b3-495a-b099-5065984b61d1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:52.946406 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a28d37ab-52b3-495a-b099-5065984b61d1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:52.953985 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a28d37ab-52b3-495a-b099-5065984b61d1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1662 microversion: 2.1 time: 0.237448 May 28 17:31:52.954563 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 385/781] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:52 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1662 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:31:53.065146 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4f8ed181-a012-4962-bd18-28881f997bbe tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:53.065770 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-4f8ed181-a012-4962-bd18-28881f997bbe tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:53.068696 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=74 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:31:53.074894 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4f8ed181-a012-4962-bd18-28881f997bbe tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:53.075369 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4f8ed181-a012-4962-bd18-28881f997bbe tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:53.076149 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4f8ed181-a012-4962-bd18-28881f997bbe tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:53.076592 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4f8ed181-a012-4962-bd18-28881f997bbe tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:53.207075 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-4f8ed181-a012-4962-bd18-28881f997bbe tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:53.215749 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-4f8ed181-a012-4962-bd18-28881f997bbe tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1734 microversion: 2.1 time: 0.154604 May 28 17:31:53.216322 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 397/782] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:53 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:53.970470 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4f78868c-0b5e-4874-b9e9-cbe969c0999f tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:53.971079 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4f78868c-0b5e-4874-b9e9-cbe969c0999f tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:53.978121 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4f78868c-0b5e-4874-b9e9-cbe969c0999f tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:53.978516 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4f78868c-0b5e-4874-b9e9-cbe969c0999f tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:53.979271 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4f78868c-0b5e-4874-b9e9-cbe969c0999f tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:53.979735 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4f78868c-0b5e-4874-b9e9-cbe969c0999f tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:54.106968 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4f78868c-0b5e-4874-b9e9-cbe969c0999f tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:54.114320 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4f78868c-0b5e-4874-b9e9-cbe969c0999f tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1662 microversion: 2.1 time: 0.147646 May 28 17:31:54.114886 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 386/783] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:53 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1662 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:54.233557 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4bc9a72b-125e-47af-91e9-c91f7b11cfae tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:54.234085 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-4bc9a72b-125e-47af-91e9-c91f7b11cfae tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:54.240556 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4bc9a72b-125e-47af-91e9-c91f7b11cfae tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:54.240994 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4bc9a72b-125e-47af-91e9-c91f7b11cfae tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:54.241750 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4bc9a72b-125e-47af-91e9-c91f7b11cfae tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:54.242185 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4bc9a72b-125e-47af-91e9-c91f7b11cfae tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:54.368876 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-4bc9a72b-125e-47af-91e9-c91f7b11cfae tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:54.376681 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-4bc9a72b-125e-47af-91e9-c91f7b11cfae tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1714 microversion: 2.1 time: 0.147152 May 28 17:31:54.378372 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 398/784] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:54 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1714 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:54.436306 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2367e0fa-c8b4-4e7c-a2b8-c2682d0a53a8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:54.436825 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2367e0fa-c8b4-4e7c-a2b8-c2682d0a53a8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:54.443053 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2367e0fa-c8b4-4e7c-a2b8-c2682d0a53a8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:54.443549 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2367e0fa-c8b4-4e7c-a2b8-c2682d0a53a8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:54.444301 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2367e0fa-c8b4-4e7c-a2b8-c2682d0a53a8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:54.444736 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2367e0fa-c8b4-4e7c-a2b8-c2682d0a53a8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:54.570133 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-2367e0fa-c8b4-4e7c-a2b8-c2682d0a53a8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] HTTP exception thrown: Cannot 'detach_volume' instance 435314f8-f9b7-4e9c-94f3-8a84190965b9 while it is in vm_state rescued May 28 17:31:54.571862 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2367e0fa-c8b4-4e7c-a2b8-c2682d0a53a8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Request method failure captured: May 28 17:31:54.571862 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: request: DELETE /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9/os-volume_attachments/465869b4-b705-4b7e-8b8f-31b1e46391b9 HTTP/1.1 May 28 17:31:54.571862 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept: application/json May 28 17:31:54.571862 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity May 28 17:31:54.571862 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Connection: close May 28 17:31:54.571862 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Length: 0 May 28 17:31:54.571862 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Type: application/json May 28 17:31:54.571862 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 May 28 17:31:54.571862 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None May 28 17:31:54.571862 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 May 28 17:31:54.571862 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABiklsVPAofKmWg7pU3upj-M8izgby3MaGFgVfx3qysxJVQ7MR6rPa0rRZjJHfi41WGdE8TyYIJQQX0sUjsJLH8BfsxgRgGUV9qPuOrFObQ92QtyvsoGrvxn8VvrbGoJALWgEDz40ZCH_F7fvXkHWOXkwKXZd7Bop_F5hWOJ0OEwQXIUYI May 28 17:31:54.571862 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Id: None May 28 17:31:54.571862 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Name: None May 28 17:31:54.571862 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed May 28 17:31:54.571862 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True May 28 17:31:54.571862 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default May 28 17:31:54.571862 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default May 28 17:31:54.571862 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Id: 8e92a5dc387f47c99ce98da4d6fd9d92 May 28 17:31:54.571862 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1728494172 May 28 17:31:54.571862 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Role: reader,member May 28 17:31:54.571862 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Roles: reader,member May 28 17:31:54.573423 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8e92a5dc387f47c99ce98da4d6fd9d92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8e92a5dc387f47c99ce98da4d6fd9d92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8e92a5dc387f47c99ce98da4d6fd9d92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8e92a5dc387f47c99ce98da4d6fd9d92", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:31:54.573423 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1728494172 May 28 17:31:54.573423 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 8e92a5dc387f47c99ce98da4d6fd9d92 May 28 17:31:54.573423 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1728494172 May 28 17:31:54.573423 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User: tempest-ServerRescueNegativeTestJSON-1728494172-project May 28 17:31:54.573423 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default May 28 17:31:54.573423 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default May 28 17:31:54.573423 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Id: 927f21ef1ca74ec58f85181728933e82 May 28 17:31:54.573423 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1728494172-project May 28 17:31:54.573423 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: method: > May 28 17:31:54.573423 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: exception: Cannot 'detach_volume' instance 435314f8-f9b7-4e9c-94f3-8a84190965b9 while it is in vm_state rescued May 28 17:31:54.574388 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: action_args: {'server_id': '435314f8-f9b7-4e9c-94f3-8a84190965b9', 'id': '465869b4-b705-4b7e-8b8f-31b1e46391b9'} May 28 17:31:54.574388 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:31:54.574388 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:31:54.574388 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 28 17:31:54.574388 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 28 17:31:54.574388 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 17:31:54.574388 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 17:31:54.574388 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 28 17:31:54.574388 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 17:31:54.574388 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 435314f8-f9b7-4e9c-94f3-8a84190965b9 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 28 17:31:54.574388 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:31:54.574388 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:31:54.574388 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:31:54.574388 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:31:54.574388 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:31:54.574388 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:31:54.574388 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:31:54.574388 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:31:54.574388 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:31:54.574388 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:31:54.575953 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 28 17:31:54.575953 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 28 17:31:54.575953 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 17:31:54.575953 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 17:31:54.575953 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 435314f8-f9b7-4e9c-94f3-8a84190965b9 while it is in vm_state rescued May 28 17:31:54.575953 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:31:54.575953 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:31:54.575953 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:31:54.575953 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:31:54.575953 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:31:54.575953 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:31:54.575953 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:31:54.575953 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:31:54.575953 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 435314f8-f9b7-4e9c-94f3-8a84190965b9 while it is in vm_state rescued May 28 17:31:54.575953 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:31:54.575953 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2367e0fa-c8b4-4e7c-a2b8-c2682d0a53a8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Returning 409 to user: Cannot 'detach_volume' instance 435314f8-f9b7-4e9c-94f3-8a84190965b9 while it is in vm_state rescued {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:31:54.577121 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2367e0fa-c8b4-4e7c-a2b8-c2682d0a53a8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "DELETE /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9/os-volume_attachments/465869b4-b705-4b7e-8b8f-31b1e46391b9" status: 409 len: 152 microversion: 2.1 time: 0.141805 May 28 17:31:54.577121 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 387/785] 10.222.0.33 () {58 vars in 1415 bytes} [Sat May 28 17:31:54 2022] DELETE /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9/os-volume_attachments/465869b4-b705-4b7e-8b8f-31b1e46391b9 => generated 152 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 28 17:31:54.582339 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-65a6e206-6ebd-4b47-b30f-7328468c21af tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:31:54.582883 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-65a6e206-6ebd-4b47-b30f-7328468c21af tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:54.589596 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-65a6e206-6ebd-4b47-b30f-7328468c21af tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:54.590047 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-65a6e206-6ebd-4b47-b30f-7328468c21af tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:54.590806 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-65a6e206-6ebd-4b47-b30f-7328468c21af tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:54.591243 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-65a6e206-6ebd-4b47-b30f-7328468c21af tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:54.658091 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-65a6e206-6ebd-4b47-b30f-7328468c21af tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "POST /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9/action" status: 202 len: 0 microversion: 2.1 time: 0.079425 May 28 17:31:54.658743 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 399/786] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 17:31:54 2022] POST /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 17:31:54.667215 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4a434de8-6926-4659-be09-a72e6cee868b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:54.667859 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4a434de8-6926-4659-be09-a72e6cee868b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:54.674808 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4a434de8-6926-4659-be09-a72e6cee868b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:54.675259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4a434de8-6926-4659-be09-a72e6cee868b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:54.676044 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4a434de8-6926-4659-be09-a72e6cee868b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:54.676487 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4a434de8-6926-4659-be09-a72e6cee868b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:54.810199 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4a434de8-6926-4659-be09-a72e6cee868b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:54.818108 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4a434de8-6926-4659-be09-a72e6cee868b tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1722 microversion: 2.1 time: 0.155238 May 28 17:31:54.818662 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 388/787] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:54 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:55.133551 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e9d5c37a-319c-440c-936b-20f560fc3829 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:55.134142 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e9d5c37a-319c-440c-936b-20f560fc3829 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:55.141586 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e9d5c37a-319c-440c-936b-20f560fc3829 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:55.142049 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e9d5c37a-319c-440c-936b-20f560fc3829 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:55.142827 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e9d5c37a-319c-440c-936b-20f560fc3829 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:55.143273 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e9d5c37a-319c-440c-936b-20f560fc3829 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:55.300102 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e9d5c37a-319c-440c-936b-20f560fc3829 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:55.308593 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e9d5c37a-319c-440c-936b-20f560fc3829 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1666 microversion: 2.1 time: 0.179653 May 28 17:31:55.319494 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 400/788] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:55 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1666 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:55.835805 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-26ea9521-57c1-4661-8c5d-5c180ccec4b5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:55.836558 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-26ea9521-57c1-4661-8c5d-5c180ccec4b5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:55.843230 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-26ea9521-57c1-4661-8c5d-5c180ccec4b5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:55.843703 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-26ea9521-57c1-4661-8c5d-5c180ccec4b5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:55.844455 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-26ea9521-57c1-4661-8c5d-5c180ccec4b5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:55.844886 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-26ea9521-57c1-4661-8c5d-5c180ccec4b5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:56.133330 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-26ea9521-57c1-4661-8c5d-5c180ccec4b5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:56.141296 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-26ea9521-57c1-4661-8c5d-5c180ccec4b5 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1722 microversion: 2.1 time: 0.309362 May 28 17:31:56.141856 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 389/789] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:55 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1722 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:57.158695 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-880ffc13-a57f-460d-8cd0-2df9564117d9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:57.159309 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-880ffc13-a57f-460d-8cd0-2df9564117d9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:57.165879 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-880ffc13-a57f-460d-8cd0-2df9564117d9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:57.166336 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-880ffc13-a57f-460d-8cd0-2df9564117d9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:57.167096 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-880ffc13-a57f-460d-8cd0-2df9564117d9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:57.167560 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-880ffc13-a57f-460d-8cd0-2df9564117d9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:57.295472 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-880ffc13-a57f-460d-8cd0-2df9564117d9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:57.303284 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-880ffc13-a57f-460d-8cd0-2df9564117d9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1722 microversion: 2.1 time: 0.148432 May 28 17:31:57.303868 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 401/790] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:57 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:58.320569 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f92db2fc-e943-43a7-9f56-116a60657278 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:58.321304 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f92db2fc-e943-43a7-9f56-116a60657278 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:58.323996 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=80 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:31:58.330012 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f92db2fc-e943-43a7-9f56-116a60657278 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:58.330466 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f92db2fc-e943-43a7-9f56-116a60657278 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:58.331241 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f92db2fc-e943-43a7-9f56-116a60657278 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:58.331708 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f92db2fc-e943-43a7-9f56-116a60657278 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:58.462928 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f92db2fc-e943-43a7-9f56-116a60657278 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:31:58.470886 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f92db2fc-e943-43a7-9f56-116a60657278 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1728 microversion: 2.1 time: 0.154196 May 28 17:31:58.471461 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 390/791] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:31:58 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:31:58.487026 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ae80717c-ee2a-4c2c-b8e6-592e1f92817e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:31:58.487543 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ae80717c-ee2a-4c2c-b8e6-592e1f92817e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:31:58.494411 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ae80717c-ee2a-4c2c-b8e6-592e1f92817e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:58.494869 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ae80717c-ee2a-4c2c-b8e6-592e1f92817e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:58.495671 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ae80717c-ee2a-4c2c-b8e6-592e1f92817e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:58.496116 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ae80717c-ee2a-4c2c-b8e6-592e1f92817e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:58.572172 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ae80717c-ee2a-4c2c-b8e6-592e1f92817e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088837 May 28 17:31:58.572704 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 402/792] 10.222.0.33 () {58 vars in 1274 bytes} [Sat May 28 17:31:58 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:31:59.674997 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-22bb6cf4-ec10-40a9-bb9f-b2ef8801b281 req-dfe7a2df-f28f-4efc-afe9-1efb5e5bd8fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "435314f8-f9b7-4e9c-94f3-8a84190965b9", "tag": "5ea754ee-2216-4168-ad09-190faba5d36c"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:31:59.684567 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-22bb6cf4-ec10-40a9-bb9f-b2ef8801b281 req-dfe7a2df-f28f-4efc-afe9-1efb5e5bd8fb service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:31:59.685281 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-22bb6cf4-ec10-40a9-bb9f-b2ef8801b281 req-dfe7a2df-f28f-4efc-afe9-1efb5e5bd8fb service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:31:59.696922 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-22bb6cf4-ec10-40a9-bb9f-b2ef8801b281 req-dfe7a2df-f28f-4efc-afe9-1efb5e5bd8fb service nova] Creating event network-changed:5ea754ee-2216-4168-ad09-190faba5d36c for instance 435314f8-f9b7-4e9c-94f3-8a84190965b9 on hv-cinder-84372 May 28 17:31:59.703104 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-22bb6cf4-ec10-40a9-bb9f-b2ef8801b281 req-dfe7a2df-f28f-4efc-afe9-1efb5e5bd8fb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031759 May 28 17:31:59.703732 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 391/793] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:32:01.718596 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-d3ce37d8-781f-416f-98f0-849158048757 req-2ad34678-5acf-4592-9261-e8b972627f67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "435314f8-f9b7-4e9c-94f3-8a84190965b9", "tag": "5ea754ee-2216-4168-ad09-190faba5d36c"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:32:01.726747 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-d3ce37d8-781f-416f-98f0-849158048757 req-2ad34678-5acf-4592-9261-e8b972627f67 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:01.727875 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-d3ce37d8-781f-416f-98f0-849158048757 req-2ad34678-5acf-4592-9261-e8b972627f67 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:01.738717 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-d3ce37d8-781f-416f-98f0-849158048757 req-2ad34678-5acf-4592-9261-e8b972627f67 service nova] Creating event network-changed:5ea754ee-2216-4168-ad09-190faba5d36c for instance 435314f8-f9b7-4e9c-94f3-8a84190965b9 on hv-cinder-84372 May 28 17:32:01.744679 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-d3ce37d8-781f-416f-98f0-849158048757 req-2ad34678-5acf-4592-9261-e8b972627f67 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030531 May 28 17:32:01.745256 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 403/794] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:32:29.441705 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0b25ebda-040c-461f-92ff-419ab5d75822 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-295021337"}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:32:29.442349 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0b25ebda-040c-461f-92ff-419ab5d75822 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:32:29.444752 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=3 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:32:29.445509 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=59 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:32:29.452451 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0b25ebda-040c-461f-92ff-419ab5d75822 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:29.452993 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0b25ebda-040c-461f-92ff-419ab5d75822 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:29.453788 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0b25ebda-040c-461f-92ff-419ab5d75822 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:29.454254 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0b25ebda-040c-461f-92ff-419ab5d75822 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:29.585483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.network.security_group_api [None req-0b25ebda-040c-461f-92ff-419ab5d75822 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Removing security group ca3cb093-79be-42e6-83d5-849146a5ec7b from port f6092e8b-c7e1-4c14-a7b3-8baa64e42a95 May 28 17:32:29.975628 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0b25ebda-040c-461f-92ff-419ab5d75822 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "POST /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a/action" status: 202 len: 0 microversion: 2.1 time: 0.538008 May 28 17:32:29.977674 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 392/795] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 17:32:29 2022] POST /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 17:32:29.983601 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=13 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:32:29.984750 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:32:29.989292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-3e1c8938-2865-4a56-a1f5-5a44b75c9c6b req-f98e3f8c-15e8-4e8d-b6f2-b12baa5da792 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c454eafd-57ce-466c-a88f-aa88a272a56a", "tag": "f6092e8b-c7e1-4c14-a7b3-8baa64e42a95"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:32:30.001213 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-3e1c8938-2865-4a56-a1f5-5a44b75c9c6b req-f98e3f8c-15e8-4e8d-b6f2-b12baa5da792 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:30.001877 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-3e1c8938-2865-4a56-a1f5-5a44b75c9c6b req-f98e3f8c-15e8-4e8d-b6f2-b12baa5da792 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:30.019895 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-3e1c8938-2865-4a56-a1f5-5a44b75c9c6b req-f98e3f8c-15e8-4e8d-b6f2-b12baa5da792 service nova] Creating event network-changed:f6092e8b-c7e1-4c14-a7b3-8baa64e42a95 for instance c454eafd-57ce-466c-a88f-aa88a272a56a on hv-cinder-84372 May 28 17:32:30.026554 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-3e1c8938-2865-4a56-a1f5-5a44b75c9c6b req-f98e3f8c-15e8-4e8d-b6f2-b12baa5da792 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044690 May 28 17:32:30.027155 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 404/796] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:32:31.790887 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-488ecf8f-9152-493d-94fe-78834737353c req-f1ad8811-2a56-4645-865f-8c531814b6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c454eafd-57ce-466c-a88f-aa88a272a56a", "tag": "f6092e8b-c7e1-4c14-a7b3-8baa64e42a95"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:32:31.801791 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-966ad01a-ae94-4bf7-8de7-fa6e52e36faf tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:32:31.802309 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-966ad01a-ae94-4bf7-8de7-fa6e52e36faf tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:32:31.805783 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-488ecf8f-9152-493d-94fe-78834737353c req-f1ad8811-2a56-4645-865f-8c531814b6b0 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:31.805783 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-488ecf8f-9152-493d-94fe-78834737353c req-f1ad8811-2a56-4645-865f-8c531814b6b0 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:31.808579 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-966ad01a-ae94-4bf7-8de7-fa6e52e36faf tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:31.809029 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-966ad01a-ae94-4bf7-8de7-fa6e52e36faf tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:31.809798 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-966ad01a-ae94-4bf7-8de7-fa6e52e36faf tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:31.810235 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-966ad01a-ae94-4bf7-8de7-fa6e52e36faf tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:31.817312 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-488ecf8f-9152-493d-94fe-78834737353c req-f1ad8811-2a56-4645-865f-8c531814b6b0 service nova] Creating event network-changed:f6092e8b-c7e1-4c14-a7b3-8baa64e42a95 for instance c454eafd-57ce-466c-a88f-aa88a272a56a on hv-cinder-84372 May 28 17:32:31.822414 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-488ecf8f-9152-493d-94fe-78834737353c req-f1ad8811-2a56-4645-865f-8c531814b6b0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036011 May 28 17:32:31.823297 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 405/797] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:32:31.900161 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-966ad01a-ae94-4bf7-8de7-fa6e52e36faf tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lazy-loading 'services' on Instance uuid c454eafd-57ce-466c-a88f-aa88a272a56a {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 17:32:32.024186 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-966ad01a-ae94-4bf7-8de7-fa6e52e36faf tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a/os-volume_attachments/d533c948-6a66-4301-8577-0535edfaa959" status: 202 len: 0 microversion: 2.1 time: 0.240254 May 28 17:32:32.024821 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 393/798] 10.222.0.33 () {58 vars in 1415 bytes} [Sat May 28 17:32:31 2022] DELETE /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a/os-volume_attachments/d533c948-6a66-4301-8577-0535edfaa959 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 17:32:32.034786 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f442cfdd-91cb-4778-8dcf-1b425a5b8228 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:32:32.044005 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f442cfdd-91cb-4778-8dcf-1b425a5b8228 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:32:32.055212 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f442cfdd-91cb-4778-8dcf-1b425a5b8228 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:32.055991 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f442cfdd-91cb-4778-8dcf-1b425a5b8228 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:32.056999 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f442cfdd-91cb-4778-8dcf-1b425a5b8228 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:32.057654 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f442cfdd-91cb-4778-8dcf-1b425a5b8228 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:32.092813 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f442cfdd-91cb-4778-8dcf-1b425a5b8228 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062736 May 28 17:32:32.093997 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 406/799] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 17:32:32 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:32:33.107450 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f764785f-ff3f-4ba0-8900-56cf566bb738 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:32:33.109302 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f764785f-ff3f-4ba0-8900-56cf566bb738 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:32:33.115505 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f764785f-ff3f-4ba0-8900-56cf566bb738 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:33.115966 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f764785f-ff3f-4ba0-8900-56cf566bb738 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:33.116723 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f764785f-ff3f-4ba0-8900-56cf566bb738 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:33.117159 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f764785f-ff3f-4ba0-8900-56cf566bb738 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:33.145758 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f764785f-ff3f-4ba0-8900-56cf566bb738 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043137 May 28 17:32:33.146547 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 394/800] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 17:32:33 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:32:34.157940 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-61e56da2-56f2-4e67-a0fa-236648a71652 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:32:34.158848 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-61e56da2-56f2-4e67-a0fa-236648a71652 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:32:34.165505 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-61e56da2-56f2-4e67-a0fa-236648a71652 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:34.165946 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-61e56da2-56f2-4e67-a0fa-236648a71652 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:34.166708 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-61e56da2-56f2-4e67-a0fa-236648a71652 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:34.167139 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-61e56da2-56f2-4e67-a0fa-236648a71652 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:34.196558 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-61e56da2-56f2-4e67-a0fa-236648a71652 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043016 May 28 17:32:34.197121 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 407/801] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 17:32:34 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 17:32:34.208086 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-415225b0-400c-412a-b9fd-4421c5c068f8 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:32:34.208643 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-415225b0-400c-412a-b9fd-4421c5c068f8 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:32:34.217593 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-415225b0-400c-412a-b9fd-4421c5c068f8 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:34.218292 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-415225b0-400c-412a-b9fd-4421c5c068f8 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:34.219532 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-415225b0-400c-412a-b9fd-4421c5c068f8 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:34.220228 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-415225b0-400c-412a-b9fd-4421c5c068f8 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:34.297034 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-415225b0-400c-412a-b9fd-4421c5c068f8 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] HTTP exception thrown: Instance c454eafd-57ce-466c-a88f-aa88a272a56a is not attached to volume d533c948-6a66-4301-8577-0535edfaa959 May 28 17:32:34.305066 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-415225b0-400c-412a-b9fd-4421c5c068f8 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Request method failure captured: May 28 17:32:34.305066 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: request: DELETE /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a/os-volume_attachments/d533c948-6a66-4301-8577-0535edfaa959 HTTP/1.1 May 28 17:32:34.305066 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept: application/json May 28 17:32:34.305066 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity May 28 17:32:34.305066 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Connection: close May 28 17:32:34.305066 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Length: 0 May 28 17:32:34.305066 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Type: application/json May 28 17:32:34.305066 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 May 28 17:32:34.305066 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None May 28 17:32:34.305066 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 May 28 17:32:34.305066 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABikluBPCIAigo-qu3NZyEAqD24H3ubjnTdV_31Lk8loyw1eGsqZWzthvrWI-nWwFhrSGdXBqNVcuhVnbUey5ETMAen2x5P2ansYxUtEPB3-DffcXcdKhLa09fpxul8UVMVS2LfzQz-ylVjSWOkFmmNtV6Wbs_sWEREeQEeBhtyBsnDEyI May 28 17:32:34.305066 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Id: None May 28 17:32:34.305066 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Name: None May 28 17:32:34.305066 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed May 28 17:32:34.305066 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True May 28 17:32:34.305066 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default May 28 17:32:34.305066 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default May 28 17:32:34.305066 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Id: 33d09d2e02c945a09e79efae8d8ab96c May 28 17:32:34.305066 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-TestMinimumBasicScenario-1048364451 May 28 17:32:34.305066 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Role: reader,member May 28 17:32:34.305066 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Roles: reader,member May 28 17:32:34.306716 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/33d09d2e02c945a09e79efae8d8ab96c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/33d09d2e02c945a09e79efae8d8ab96c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/33d09d2e02c945a09e79efae8d8ab96c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_33d09d2e02c945a09e79efae8d8ab96c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:32:34.306716 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-TestMinimumBasicScenario-1048364451 May 28 17:32:34.306716 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 33d09d2e02c945a09e79efae8d8ab96c May 28 17:32:34.306716 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1048364451 May 28 17:32:34.306716 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User: tempest-TestMinimumBasicScenario-1048364451-project May 28 17:32:34.306716 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default May 28 17:32:34.306716 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default May 28 17:32:34.306716 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Id: 681c8dec79764371badd23608ff4fa5a May 28 17:32:34.306716 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-TestMinimumBasicScenario-1048364451-project May 28 17:32:34.306716 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: method: > May 28 17:32:34.306716 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: exception: Instance c454eafd-57ce-466c-a88f-aa88a272a56a is not attached to volume d533c948-6a66-4301-8577-0535edfaa959 May 28 17:32:34.307549 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: action_args: {'server_id': 'c454eafd-57ce-466c-a88f-aa88a272a56a', 'id': 'd533c948-6a66-4301-8577-0535edfaa959'} May 28 17:32:34.307549 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:32:34.307549 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:32:34.307549 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 28 17:32:34.307549 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 28 17:32:34.307549 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 17:32:34.307549 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 17:32:34.307549 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 28 17:32:34.307549 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 28 17:32:34.307549 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d533c948-6a66-4301-8577-0535edfaa959. May 28 17:32:34.307549 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:32:34.307549 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:32:34.307549 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:32:34.307549 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:32:34.307549 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:32:34.307549 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:32:34.307549 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:32:34.307549 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:32:34.307549 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:32:34.308726 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:32:34.308726 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 28 17:32:34.308726 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 28 17:32:34.308726 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c454eafd-57ce-466c-a88f-aa88a272a56a is not attached to volume d533c948-6a66-4301-8577-0535edfaa959 May 28 17:32:34.308726 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:32:34.308726 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:32:34.308726 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:32:34.308726 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:32:34.308726 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:32:34.308726 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:32:34.308726 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:32:34.308726 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:32:34.308726 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c454eafd-57ce-466c-a88f-aa88a272a56a is not attached to volume d533c948-6a66-4301-8577-0535edfaa959 May 28 17:32:34.308726 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:32:34.308726 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-415225b0-400c-412a-b9fd-4421c5c068f8 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Returning 404 to user: Instance c454eafd-57ce-466c-a88f-aa88a272a56a is not attached to volume d533c948-6a66-4301-8577-0535edfaa959 {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:32:34.309635 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-415225b0-400c-412a-b9fd-4421c5c068f8 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a/os-volume_attachments/d533c948-6a66-4301-8577-0535edfaa959" status: 404 len: 154 microversion: 2.1 time: 0.102500 May 28 17:32:34.309635 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 395/802] 10.222.0.33 () {58 vars in 1415 bytes} [Sat May 28 17:32:34 2022] DELETE /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a/os-volume_attachments/d533c948-6a66-4301-8577-0535edfaa959 => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:32:35.441613 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-08ad3bb2-472e-4e0d-8e8f-d239f62c6976 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:32:35.442192 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-08ad3bb2-472e-4e0d-8e8f-d239f62c6976 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:32:35.448557 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-08ad3bb2-472e-4e0d-8e8f-d239f62c6976 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:35.449005 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-08ad3bb2-472e-4e0d-8e8f-d239f62c6976 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:35.449765 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-08ad3bb2-472e-4e0d-8e8f-d239f62c6976 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:35.450206 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-08ad3bb2-472e-4e0d-8e8f-d239f62c6976 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:35.476445 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-08ad3bb2-472e-4e0d-8e8f-d239f62c6976 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Going to try to terminate instance {{(pid=117604) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 17:32:35.548884 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-08ad3bb2-472e-4e0d-8e8f-d239f62c6976 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 204 len: 0 microversion: 2.1 time: 0.110881 May 28 17:32:35.549462 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 408/803] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 17:32:35 2022] DELETE /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 17:32:35.558104 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c1aa119b-f003-4926-8d86-c679a406411d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:32:35.558726 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c1aa119b-f003-4926-8d86-c679a406411d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:32:35.566085 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c1aa119b-f003-4926-8d86-c679a406411d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:35.566530 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c1aa119b-f003-4926-8d86-c679a406411d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:35.567296 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c1aa119b-f003-4926-8d86-c679a406411d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:35.567760 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c1aa119b-f003-4926-8d86-c679a406411d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:35.700002 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c1aa119b-f003-4926-8d86-c679a406411d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:35.708075 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c1aa119b-f003-4926-8d86-c679a406411d tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1553 microversion: 2.1 time: 0.154251 May 28 17:32:35.708625 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 396/804] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:32:35 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:32:36.726619 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f852bad6-6482-46ea-92a3-8d3a59d42d32 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:32:36.727325 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f852bad6-6482-46ea-92a3-8d3a59d42d32 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:32:36.733932 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f852bad6-6482-46ea-92a3-8d3a59d42d32 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:36.734378 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f852bad6-6482-46ea-92a3-8d3a59d42d32 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:36.735142 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f852bad6-6482-46ea-92a3-8d3a59d42d32 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:36.735615 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f852bad6-6482-46ea-92a3-8d3a59d42d32 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:36.862933 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f852bad6-6482-46ea-92a3-8d3a59d42d32 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:36.870357 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f852bad6-6482-46ea-92a3-8d3a59d42d32 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1553 microversion: 2.1 time: 0.147971 May 28 17:32:36.870915 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 409/805] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:32:36 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:32:37.989944 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ede3d5f0-582e-4fea-9539-fa4485309172 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:32:37.990673 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ede3d5f0-582e-4fea-9539-fa4485309172 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:32:37.996823 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ede3d5f0-582e-4fea-9539-fa4485309172 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:37.997355 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ede3d5f0-582e-4fea-9539-fa4485309172 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:37.998165 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ede3d5f0-582e-4fea-9539-fa4485309172 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:37.998578 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ede3d5f0-582e-4fea-9539-fa4485309172 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:38.127514 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ede3d5f0-582e-4fea-9539-fa4485309172 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:38.135050 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ede3d5f0-582e-4fea-9539-fa4485309172 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1553 microversion: 2.1 time: 0.252318 May 28 17:32:38.135634 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 397/806] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:32:37 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1553 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:32:38.641110 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-e1dc6251-ff5e-4093-8106-e228e9121da5 req-2633a242-da81-45ee-a7f8-882a6d695f88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c454eafd-57ce-466c-a88f-aa88a272a56a", "name": "network-vif-deleted", "tag": "f6092e8b-c7e1-4c14-a7b3-8baa64e42a95"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:32:38.651147 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-e1dc6251-ff5e-4093-8106-e228e9121da5 req-2633a242-da81-45ee-a7f8-882a6d695f88 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:38.651664 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-e1dc6251-ff5e-4093-8106-e228e9121da5 req-2633a242-da81-45ee-a7f8-882a6d695f88 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:38.663670 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-e1dc6251-ff5e-4093-8106-e228e9121da5 req-2633a242-da81-45ee-a7f8-882a6d695f88 service nova] Creating event network-vif-deleted:f6092e8b-c7e1-4c14-a7b3-8baa64e42a95 for instance c454eafd-57ce-466c-a88f-aa88a272a56a on hv-cinder-84372 May 28 17:32:38.668864 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-e1dc6251-ff5e-4093-8106-e228e9121da5 req-2633a242-da81-45ee-a7f8-882a6d695f88 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032037 May 28 17:32:38.669452 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 410/807] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:32:39.153363 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3469a034-e37a-40ba-8f9f-f89120bfc920 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:32:39.154201 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3469a034-e37a-40ba-8f9f-f89120bfc920 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:32:39.163105 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3469a034-e37a-40ba-8f9f-f89120bfc920 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:39.163708 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3469a034-e37a-40ba-8f9f-f89120bfc920 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:39.164514 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3469a034-e37a-40ba-8f9f-f89120bfc920 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:39.164949 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3469a034-e37a-40ba-8f9f-f89120bfc920 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:39.200410 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3469a034-e37a-40ba-8f9f-f89120bfc920 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:39.200984 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3469a034-e37a-40ba-8f9f-f89120bfc920 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:39.201992 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-3469a034-e37a-40ba-8f9f-f89120bfc920 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lazy-loading 'fault' on Instance uuid c454eafd-57ce-466c-a88f-aa88a272a56a {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 17:32:39.245896 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3469a034-e37a-40ba-8f9f-f89120bfc920 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681c8dec79764371badd23608ff4fa5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d09d2e02c945a09e79efae8d8ab96c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:39.252904 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3469a034-e37a-40ba-8f9f-f89120bfc920 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 200 len: 1348 microversion: 2.1 time: 0.104662 May 28 17:32:39.253630 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 398/808] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:32:39 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 1348 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:32:40.272219 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-97cca25e-6361-408b-beb8-05ec11905be0 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:32:40.272954 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-97cca25e-6361-408b-beb8-05ec11905be0 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] [instance: c454eafd-57ce-466c-a88f-aa88a272a56a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:32:40.279209 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-97cca25e-6361-408b-beb8-05ec11905be0 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:40.280388 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-97cca25e-6361-408b-beb8-05ec11905be0 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:40.281163 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-97cca25e-6361-408b-beb8-05ec11905be0 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:40.281606 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-97cca25e-6361-408b-beb8-05ec11905be0 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:40.296629 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-97cca25e-6361-408b-beb8-05ec11905be0 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] HTTP exception thrown: Instance c454eafd-57ce-466c-a88f-aa88a272a56a could not be found. May 28 17:32:40.298249 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-97cca25e-6361-408b-beb8-05ec11905be0 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Request method failure captured: May 28 17:32:40.298249 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a HTTP/1.1 May 28 17:32:40.298249 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:32:40.298249 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:32:40.298249 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:32:40.298249 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 0 May 28 17:32:40.298249 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:32:40.298249 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:32:40.298249 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:32:40.298249 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:32:40.298249 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABikluBPCIAigo-qu3NZyEAqD24H3ubjnTdV_31Lk8loyw1eGsqZWzthvrWI-nWwFhrSGdXBqNVcuhVnbUey5ETMAen2x5P2ansYxUtEPB3-DffcXcdKhLa09fpxul8UVMVS2LfzQz-ylVjSWOkFmmNtV6Wbs_sWEREeQEeBhtyBsnDEyI May 28 17:32:40.298249 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:32:40.298249 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:32:40.298249 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:32:40.298249 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:32:40.298249 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:32:40.298249 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:32:40.298249 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: 33d09d2e02c945a09e79efae8d8ab96c May 28 17:32:40.298249 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-TestMinimumBasicScenario-1048364451 May 28 17:32:40.298249 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:32:40.298249 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:32:40.299594 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/33d09d2e02c945a09e79efae8d8ab96c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/33d09d2e02c945a09e79efae8d8ab96c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/33d09d2e02c945a09e79efae8d8ab96c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_33d09d2e02c945a09e79efae8d8ab96c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:32:40.299594 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-TestMinimumBasicScenario-1048364451 May 28 17:32:40.299594 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 33d09d2e02c945a09e79efae8d8ab96c May 28 17:32:40.299594 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1048364451 May 28 17:32:40.299594 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-TestMinimumBasicScenario-1048364451-project May 28 17:32:40.299594 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:32:40.299594 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:32:40.299594 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: 681c8dec79764371badd23608ff4fa5a May 28 17:32:40.299594 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-TestMinimumBasicScenario-1048364451-project May 28 17:32:40.299594 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: > May 28 17:32:40.299594 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Instance c454eafd-57ce-466c-a88f-aa88a272a56a could not be found. May 28 17:32:40.299594 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'id': 'c454eafd-57ce-466c-a88f-aa88a272a56a'} May 28 17:32:40.300423 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:32:40.300423 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:32:40.300423 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:32:40.300423 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:32:40.300423 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:32:40.300423 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:32:40.300423 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:32:40.300423 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:32:40.300423 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:32:40.300423 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:32:40.300423 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c454eafd-57ce-466c-a88f-aa88a272a56a could not be found. May 28 17:32:40.300423 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:32:40.300423 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:32:40.300423 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:32:40.300423 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:32:40.300423 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:32:40.300423 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:32:40.300423 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:32:40.300423 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:32:40.300423 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:32:40.301637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:32:40.301637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:32:40.301637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:32:40.301637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:32:40.301637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:32:40.301637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:32:40.301637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:32:40.301637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c454eafd-57ce-466c-a88f-aa88a272a56a could not be found. May 28 17:32:40.301637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:32:40.301637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:32:40.301637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:32:40.301637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:32:40.301637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:32:40.301637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:32:40.301637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:32:40.301637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:32:40.301637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c454eafd-57ce-466c-a88f-aa88a272a56a could not be found. May 28 17:32:40.301637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:32:40.302746 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-97cca25e-6361-408b-beb8-05ec11905be0 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Returning 404 to user: Instance c454eafd-57ce-466c-a88f-aa88a272a56a could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:32:40.302746 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-97cca25e-6361-408b-beb8-05ec11905be0 tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a" status: 404 len: 111 microversion: 2.1 time: 0.032279 May 28 17:32:40.302746 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 411/809] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:32:40 2022] GET /compute/v2.1/servers/c454eafd-57ce-466c-a88f-aa88a272a56a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:32:40.308558 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-aacab8da-b33a-4b94-b6fc-c1ba95c1307c tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] Calling method '.version_select at 0x7f9efc1edca0>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:32:40.327637 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-aacab8da-b33a-4b94-b6fc-c1ba95c1307c tempest-TestMinimumBasicScenario-1048364451 tempest-TestMinimumBasicScenario-1048364451-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1683839053" status: 202 len: 0 microversion: 2.1 time: 0.022797 May 28 17:32:40.328203 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 399/810] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 17:32:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1683839053 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 17:32:43.242328 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f79cf9cd-990b-4761-8e8c-01e0ec29bb22 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:32:43.242832 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f79cf9cd-990b-4761-8e8c-01e0ec29bb22 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:32:43.249855 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f79cf9cd-990b-4761-8e8c-01e0ec29bb22 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:43.250409 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f79cf9cd-990b-4761-8e8c-01e0ec29bb22 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:43.251183 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f79cf9cd-990b-4761-8e8c-01e0ec29bb22 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:43.251748 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f79cf9cd-990b-4761-8e8c-01e0ec29bb22 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:43.283429 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f79cf9cd-990b-4761-8e8c-01e0ec29bb22 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334/os-volume_attachments/6a7d2b06-cc54-41b5-8dbb-a78e1d1d7911" status: 200 len: 194 microversion: 2.20 time: 0.170775 May 28 17:32:43.284029 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 412/811] 10.222.0.33 () {60 vars in 1453 bytes} [Sat May 28 17:32:43 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334/os-volume_attachments/6a7d2b06-cc54-41b5-8dbb-a78e1d1d7911 => generated 194 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 17:32:43.349210 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-625b9ae8-0382-47f7-9e77-eeedd13bce4c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:32:43.349781 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-625b9ae8-0382-47f7-9e77-eeedd13bce4c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:32:43.356257 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-625b9ae8-0382-47f7-9e77-eeedd13bce4c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:43.356713 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-625b9ae8-0382-47f7-9e77-eeedd13bce4c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:43.357520 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-625b9ae8-0382-47f7-9e77-eeedd13bce4c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:43.357956 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-625b9ae8-0382-47f7-9e77-eeedd13bce4c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:43.447846 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-625b9ae8-0382-47f7-9e77-eeedd13bce4c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lazy-loading 'services' on Instance uuid 1e52b200-7c75-45f2-92ed-813b306fc334 {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 17:32:43.520145 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-625b9ae8-0382-47f7-9e77-eeedd13bce4c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334/os-volume_attachments/6a7d2b06-cc54-41b5-8dbb-a78e1d1d7911" status: 202 len: 0 microversion: 2.20 time: 0.175579 May 28 17:32:43.520791 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 400/812] 10.222.0.33 () {60 vars in 1456 bytes} [Sat May 28 17:32:43 2022] DELETE /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334/os-volume_attachments/6a7d2b06-cc54-41b5-8dbb-a78e1d1d7911 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 17:32:43.530164 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ea80fdc3-96b9-477a-a295-0c0e414e50e4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:32:43.531103 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ea80fdc3-96b9-477a-a295-0c0e414e50e4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:32:43.538669 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ea80fdc3-96b9-477a-a295-0c0e414e50e4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:43.539314 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ea80fdc3-96b9-477a-a295-0c0e414e50e4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:43.540295 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ea80fdc3-96b9-477a-a295-0c0e414e50e4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:43.540894 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ea80fdc3-96b9-477a-a295-0c0e414e50e4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:43.587288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ea80fdc3-96b9-477a-a295-0c0e414e50e4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061764 May 28 17:32:43.588439 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 413/813] 10.222.0.33 () {60 vars in 1342 bytes} [Sat May 28 17:32:43 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 17:32:44.601518 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9bfe4bbb-eda5-4cb4-9832-78bf92af1928 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:32:44.603453 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9bfe4bbb-eda5-4cb4-9832-78bf92af1928 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:32:44.610166 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9bfe4bbb-eda5-4cb4-9832-78bf92af1928 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:44.610696 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9bfe4bbb-eda5-4cb4-9832-78bf92af1928 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:44.611599 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9bfe4bbb-eda5-4cb4-9832-78bf92af1928 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:44.612114 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9bfe4bbb-eda5-4cb4-9832-78bf92af1928 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:44.644807 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9bfe4bbb-eda5-4cb4-9832-78bf92af1928 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048453 May 28 17:32:44.645489 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 401/814] 10.222.0.33 () {60 vars in 1342 bytes} [Sat May 28 17:32:44 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:32:44.711716 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1bedcb66-32d7-41b8-adcf-898795f8a80a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:32:44.712312 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1bedcb66-32d7-41b8-adcf-898795f8a80a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:32:44.719070 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1bedcb66-32d7-41b8-adcf-898795f8a80a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:44.719614 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1bedcb66-32d7-41b8-adcf-898795f8a80a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:44.720402 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1bedcb66-32d7-41b8-adcf-898795f8a80a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:44.720860 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1bedcb66-32d7-41b8-adcf-898795f8a80a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:44.746171 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1bedcb66-32d7-41b8-adcf-898795f8a80a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Going to try to terminate instance {{(pid=117604) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 17:32:44.826948 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1bedcb66-32d7-41b8-adcf-898795f8a80a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 204 len: 0 microversion: 2.20 time: 0.118609 May 28 17:32:44.828261 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 414/815] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 17:32:44 2022] DELETE /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 17:32:44.837126 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3ad1be68-ff20-4dda-bb5a-99fc8cecc4dd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:32:44.837956 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3ad1be68-ff20-4dda-bb5a-99fc8cecc4dd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:32:44.844105 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3ad1be68-ff20-4dda-bb5a-99fc8cecc4dd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:44.844562 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3ad1be68-ff20-4dda-bb5a-99fc8cecc4dd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:44.845335 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3ad1be68-ff20-4dda-bb5a-99fc8cecc4dd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:44.845781 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3ad1be68-ff20-4dda-bb5a-99fc8cecc4dd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:44.987840 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3ad1be68-ff20-4dda-bb5a-99fc8cecc4dd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:44.996128 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3ad1be68-ff20-4dda-bb5a-99fc8cecc4dd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:44.997946 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3ad1be68-ff20-4dda-bb5a-99fc8cecc4dd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:44.999871 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3ad1be68-ff20-4dda-bb5a-99fc8cecc4dd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1725 microversion: 2.20 time: 0.167117 May 28 17:32:45.000654 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 402/816] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:32:44 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:32:46.019960 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9684863e-6d4e-4728-a180-79d412d3dab8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:32:46.020666 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9684863e-6d4e-4728-a180-79d412d3dab8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:32:46.027661 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9684863e-6d4e-4728-a180-79d412d3dab8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:46.028112 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9684863e-6d4e-4728-a180-79d412d3dab8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:46.028995 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9684863e-6d4e-4728-a180-79d412d3dab8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:46.029473 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9684863e-6d4e-4728-a180-79d412d3dab8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:46.350895 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9684863e-6d4e-4728-a180-79d412d3dab8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:46.359423 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9684863e-6d4e-4728-a180-79d412d3dab8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:46.361116 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9684863e-6d4e-4728-a180-79d412d3dab8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:46.362397 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9684863e-6d4e-4728-a180-79d412d3dab8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1725 microversion: 2.20 time: 0.346840 May 28 17:32:46.363390 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 415/817] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:32:46 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1725 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:32:47.380802 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-849802f4-afa5-4029-8f3e-57ea8e9f95ea tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:32:47.381985 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-849802f4-afa5-4029-8f3e-57ea8e9f95ea tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:32:47.388596 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-849802f4-afa5-4029-8f3e-57ea8e9f95ea tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:47.389474 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-849802f4-afa5-4029-8f3e-57ea8e9f95ea tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:47.390661 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-849802f4-afa5-4029-8f3e-57ea8e9f95ea tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:47.391111 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-849802f4-afa5-4029-8f3e-57ea8e9f95ea tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:47.647928 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-849802f4-afa5-4029-8f3e-57ea8e9f95ea tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:47.662504 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-849802f4-afa5-4029-8f3e-57ea8e9f95ea tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:47.664348 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-849802f4-afa5-4029-8f3e-57ea8e9f95ea tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:47.672882 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-849802f4-afa5-4029-8f3e-57ea8e9f95ea tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 200 len: 1725 microversion: 2.20 time: 0.291106 May 28 17:32:47.674238 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 403/818] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:32:47 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 1725 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:32:48.092844 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-2448fa03-d1fa-460b-84be-51dbe98c779a req-9059d6e6-c744-41d1-ad97-69e8a2351540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e52b200-7c75-45f2-92ed-813b306fc334", "name": "network-vif-deleted", "tag": "48f2ad05-071e-4e67-9258-657db8e5bedf"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:32:48.101723 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-2448fa03-d1fa-460b-84be-51dbe98c779a req-9059d6e6-c744-41d1-ad97-69e8a2351540 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:48.102167 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-2448fa03-d1fa-460b-84be-51dbe98c779a req-9059d6e6-c744-41d1-ad97-69e8a2351540 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:48.114091 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-2448fa03-d1fa-460b-84be-51dbe98c779a req-9059d6e6-c744-41d1-ad97-69e8a2351540 service nova] Creating event network-vif-deleted:48f2ad05-071e-4e67-9258-657db8e5bedf for instance 1e52b200-7c75-45f2-92ed-813b306fc334 on hv-cinder-84372 May 28 17:32:48.118795 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-2448fa03-d1fa-460b-84be-51dbe98c779a req-9059d6e6-c744-41d1-ad97-69e8a2351540 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029794 May 28 17:32:48.119439 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 416/819] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:32:48.692385 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8d3c61c5-6276-40d0-a4d7-004d6b8f355a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:32:48.693897 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8d3c61c5-6276-40d0-a4d7-004d6b8f355a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:32:48.703442 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8d3c61c5-6276-40d0-a4d7-004d6b8f355a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:48.704214 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8d3c61c5-6276-40d0-a4d7-004d6b8f355a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:48.705229 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8d3c61c5-6276-40d0-a4d7-004d6b8f355a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:48.705895 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8d3c61c5-6276-40d0-a4d7-004d6b8f355a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:48.735059 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-8d3c61c5-6276-40d0-a4d7-004d6b8f355a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] HTTP exception thrown: Instance 1e52b200-7c75-45f2-92ed-813b306fc334 could not be found. May 28 17:32:48.737304 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8d3c61c5-6276-40d0-a4d7-004d6b8f355a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Request method failure captured: May 28 17:32:48.737304 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 HTTP/1.1 May 28 17:32:48.737304 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept: application/json May 28 17:32:48.737304 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity May 28 17:32:48.737304 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Connection: close May 28 17:32:48.737304 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Length: 0 May 28 17:32:48.737304 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Type: application/json May 28 17:32:48.737304 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 May 28 17:32:48.737304 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None May 28 17:32:48.737304 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 May 28 17:32:48.737304 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABiklt0ryigSES2va0FJ5urnH-xGPHxC2ofGmHZJwTcOlD6rM0ANKwwYZPb96v1LqEjiGMXf0HExZtWCwjd26LOuC9S5qOYFPKmaY81VW-Iz8BFNQMQ1GSjg9MeNtwueDXFDFVLCzX8HxCa7EJe3Wbi5d9p8fynqoJNgd_K7l6YAFVc3Zk May 28 17:32:48.737304 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Id: None May 28 17:32:48.737304 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Name: None May 28 17:32:48.737304 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed May 28 17:32:48.737304 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True May 28 17:32:48.737304 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Openstack-Nova-Api-Version: 2.20 May 28 17:32:48.737304 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default May 28 17:32:48.737304 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default May 28 17:32:48.737304 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Id: afaaf8bde7134efc80c77d707bb309bc May 28 17:32:48.737304 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-730962505 May 28 17:32:48.737304 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Role: reader,member May 28 17:32:48.737304 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Roles: reader,member May 28 17:32:48.738758 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afaaf8bde7134efc80c77d707bb309bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afaaf8bde7134efc80c77d707bb309bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/afaaf8bde7134efc80c77d707bb309bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_afaaf8bde7134efc80c77d707bb309bc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:32:48.738758 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeShelveTestJSON-730962505 May 28 17:32:48.738758 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Id: afaaf8bde7134efc80c77d707bb309bc May 28 17:32:48.738758 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-730962505 May 28 17:32:48.738758 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeShelveTestJSON-730962505-project May 28 17:32:48.738758 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default May 28 17:32:48.738758 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default May 28 17:32:48.738758 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Id: 710b406ba65646ed94c3f9d356b161f1 May 28 17:32:48.738758 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeShelveTestJSON-730962505-project May 28 17:32:48.738758 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: method: > May 28 17:32:48.738758 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: exception: Instance 1e52b200-7c75-45f2-92ed-813b306fc334 could not be found. May 28 17:32:48.738758 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: action_args: {'id': '1e52b200-7c75-45f2-92ed-813b306fc334'} May 28 17:32:48.739544 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:32:48.739544 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:32:48.739544 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:32:48.739544 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:32:48.739544 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:32:48.739544 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:32:48.739544 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:32:48.739544 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:32:48.739544 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:32:48.739544 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:32:48.739544 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e52b200-7c75-45f2-92ed-813b306fc334 could not be found. May 28 17:32:48.739544 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:32:48.739544 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:32:48.739544 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:32:48.739544 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:32:48.739544 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:32:48.739544 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:32:48.739544 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:32:48.739544 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:32:48.739544 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:32:48.740799 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:32:48.740799 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:32:48.740799 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:32:48.740799 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:32:48.740799 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:32:48.740799 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:32:48.740799 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:32:48.740799 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e52b200-7c75-45f2-92ed-813b306fc334 could not be found. May 28 17:32:48.740799 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:32:48.740799 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:32:48.740799 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:32:48.740799 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:32:48.740799 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:32:48.740799 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:32:48.740799 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:32:48.740799 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:32:48.740799 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e52b200-7c75-45f2-92ed-813b306fc334 could not be found. May 28 17:32:48.740799 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:32:48.741878 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8d3c61c5-6276-40d0-a4d7-004d6b8f355a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Returning 404 to user: Instance 1e52b200-7c75-45f2-92ed-813b306fc334 could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:32:48.741878 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8d3c61c5-6276-40d0-a4d7-004d6b8f355a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 404 len: 111 microversion: 2.20 time: 0.051254 May 28 17:32:48.741878 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 404/820] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:32:48 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 17:32:48.748784 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6c16e151-e2eb-4b11-aeef-f9450aa37249 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '.version_select at 0x7f9efc0cc1f0>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:32:48.772237 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6c16e151-e2eb-4b11-aeef-f9450aa37249 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1904964645" status: 204 len: 0 microversion: 2.20 time: 0.027880 May 28 17:32:48.773148 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 417/821] 10.222.0.33 () {60 vars in 1261 bytes} [Sat May 28 17:32:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1904964645 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 17:32:49.538243 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6565fa12-58a3-49b9-8c56-3be7310901cc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Action: 'create', calling method: .version_select at 0x7f9efc15d790>, body: {"keypair": {"name": "tempest-keypair-1442268248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnSzpFplfDpYWtcTejoVmc3G7AKeRDD6KzsWqO8/JxNfqETPjO5NQy3pLClMVrVfWXW71M9Eepo7PhGRFgsLImGIDaqXErRQD5JTZVs5HnBUqSXAcAVzpp7pKxUEJo1tQ=="}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:32:49.551893 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-6565fa12-58a3-49b9-8c56-3be7310901cc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Getting quotas for project afaaf8bde7134efc80c77d707bb309bc. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:32:49.555682 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-6565fa12-58a3-49b9-8c56-3be7310901cc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Getting quotas for user 710b406ba65646ed94c3f9d356b161f1 and project afaaf8bde7134efc80c77d707bb309bc. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:32:49.578042 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6565fa12-58a3-49b9-8c56-3be7310901cc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.043689 May 28 17:32:49.578629 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 405/822] 10.222.0.33 () {62 vars in 1199 bytes} [Sat May 28 17:32:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 45 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 28 17:32:50.885354 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b5fc33e0-4955-41a6-ab17-740b51423286 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-419810950", "imageRef": "b2aab55c-a793-472a-bc32-81af689ad609", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9aa607a6-b193-4d84-be0c-e5c8f4a565d2"}], "security_groups": [{"name": "tempest-securitygroup--820944563"}], "key_name": "tempest-keypair-1442268248", "user_data": "}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:32:50.986738 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.network.neutron [None req-b5fc33e0-4955-41a6-ab17-740b51423286 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] validate_networks() for [('9aa607a6-b193-4d84-be0c-e5c8f4a565d2', None, None, None, None, None)] {{(pid=117604) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 17:32:51.340195 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-b5fc33e0-4955-41a6-ab17-740b51423286 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Flavor limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 17:32:51.340630 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-b5fc33e0-4955-41a6-ab17-740b51423286 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Image limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 17:32:51.341111 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-b5fc33e0-4955-41a6-ab17-740b51423286 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Flavor pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 17:32:51.341525 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-b5fc33e0-4955-41a6-ab17-740b51423286 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Image pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 17:32:51.342435 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-b5fc33e0-4955-41a6-ab17-740b51423286 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 17:32:51.351226 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b5fc33e0-4955-41a6-ab17-740b51423286 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:51.351706 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b5fc33e0-4955-41a6-ab17-740b51423286 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:51.352511 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b5fc33e0-4955-41a6-ab17-740b51423286 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:51.352951 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b5fc33e0-4955-41a6-ab17-740b51423286 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:51.370546 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-b5fc33e0-4955-41a6-ab17-740b51423286 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Getting quotas for project afaaf8bde7134efc80c77d707bb309bc. Resources: {'instances', 'cores', 'ram'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:32:51.374609 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-b5fc33e0-4955-41a6-ab17-740b51423286 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Getting quotas for user 710b406ba65646ed94c3f9d356b161f1 and project afaaf8bde7134efc80c77d707bb309bc. Resources: {'instances', 'cores', 'ram'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:32:51.385736 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b5fc33e0-4955-41a6-ab17-740b51423286 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Going to run 1 instances... {{(pid=117604) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 17:32:51.388175 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b5fc33e0-4955-41a6-ab17-740b51423286 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b2aab55c-a793-472a-bc32-81af689ad609',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 17:32:51.435414 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b5fc33e0-4955-41a6-ab17-740b51423286 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.555265 May 28 17:32:51.436418 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 418/823] 10.222.0.33 () {62 vars in 1187 bytes} [Sat May 28 17:32:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 17:32:51.447235 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2980d688-9d64-426e-992c-3093fdbb03e9 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:32:51.447985 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2980d688-9d64-426e-992c-3093fdbb03e9 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:32:51.502084 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2980d688-9d64-426e-992c-3093fdbb03e9 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:51.510227 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2980d688-9d64-426e-992c-3093fdbb03e9 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:51.511808 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2980d688-9d64-426e-992c-3093fdbb03e9 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:51.512834 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2980d688-9d64-426e-992c-3093fdbb03e9 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1281 microversion: 2.20 time: 0.070128 May 28 17:32:51.513378 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 406/824] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:32:51 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:32:52.530457 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b316c18d-e931-4012-8c1c-3e6a50ea1851 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:32:52.531110 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b316c18d-e931-4012-8c1c-3e6a50ea1851 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:32:52.537616 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b316c18d-e931-4012-8c1c-3e6a50ea1851 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:52.538052 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b316c18d-e931-4012-8c1c-3e6a50ea1851 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:52.538811 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b316c18d-e931-4012-8c1c-3e6a50ea1851 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:52.539241 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b316c18d-e931-4012-8c1c-3e6a50ea1851 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:52.617198 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b316c18d-e931-4012-8c1c-3e6a50ea1851 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:52.626115 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b316c18d-e931-4012-8c1c-3e6a50ea1851 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:52.627644 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b316c18d-e931-4012-8c1c-3e6a50ea1851 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:52.628744 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b316c18d-e931-4012-8c1c-3e6a50ea1851 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1351 microversion: 2.20 time: 0.102281 May 28 17:32:52.629293 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 419/825] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:32:52 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:32:53.647364 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a2c1cdd7-ddb5-4ba1-a625-90c940ad4dd5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:32:53.647941 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a2c1cdd7-ddb5-4ba1-a625-90c940ad4dd5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:32:53.654755 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a2c1cdd7-ddb5-4ba1-a625-90c940ad4dd5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:53.655325 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a2c1cdd7-ddb5-4ba1-a625-90c940ad4dd5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:53.656234 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a2c1cdd7-ddb5-4ba1-a625-90c940ad4dd5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:53.656938 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a2c1cdd7-ddb5-4ba1-a625-90c940ad4dd5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:53.799733 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a2c1cdd7-ddb5-4ba1-a625-90c940ad4dd5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:53.808144 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a2c1cdd7-ddb5-4ba1-a625-90c940ad4dd5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:53.809511 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a2c1cdd7-ddb5-4ba1-a625-90c940ad4dd5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:53.811573 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a2c1cdd7-ddb5-4ba1-a625-90c940ad4dd5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1406 microversion: 2.20 time: 0.167558 May 28 17:32:53.812511 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 407/826] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:32:53 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:32:53.981977 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-36996a53-352f-4bd4-9ed5-07962dbb7ced req-910f25c0-f5e8-4927-b352-0acc00700dce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27322ac4-8704-4f1a-b431-e5c4ad7d77ad", "tag": "e951fe87-910c-4495-88e9-a876c275be25"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:32:53.994037 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-36996a53-352f-4bd4-9ed5-07962dbb7ced req-910f25c0-f5e8-4927-b352-0acc00700dce service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:53.994792 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-36996a53-352f-4bd4-9ed5-07962dbb7ced req-910f25c0-f5e8-4927-b352-0acc00700dce service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:54.009114 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-36996a53-352f-4bd4-9ed5-07962dbb7ced req-910f25c0-f5e8-4927-b352-0acc00700dce service nova] Creating event network-changed:e951fe87-910c-4495-88e9-a876c275be25 for instance 27322ac4-8704-4f1a-b431-e5c4ad7d77ad on hv-cinder-84372 May 28 17:32:54.015215 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-36996a53-352f-4bd4-9ed5-07962dbb7ced req-910f25c0-f5e8-4927-b352-0acc00700dce service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043908 May 28 17:32:54.016504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 420/827] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:32:54.832044 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c8bc1250-f307-4ddc-a70f-1dfd7e2f9f7a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:32:54.832656 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c8bc1250-f307-4ddc-a70f-1dfd7e2f9f7a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:32:54.839050 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c8bc1250-f307-4ddc-a70f-1dfd7e2f9f7a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:54.839528 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c8bc1250-f307-4ddc-a70f-1dfd7e2f9f7a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:54.840283 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c8bc1250-f307-4ddc-a70f-1dfd7e2f9f7a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:54.840714 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c8bc1250-f307-4ddc-a70f-1dfd7e2f9f7a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:54.967770 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c8bc1250-f307-4ddc-a70f-1dfd7e2f9f7a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:54.975632 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c8bc1250-f307-4ddc-a70f-1dfd7e2f9f7a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:54.977120 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c8bc1250-f307-4ddc-a70f-1dfd7e2f9f7a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:54.978218 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c8bc1250-f307-4ddc-a70f-1dfd7e2f9f7a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1406 microversion: 2.20 time: 0.150049 May 28 17:32:54.978770 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 408/828] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:32:54 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:32:55.996718 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4936453f-0807-440c-8897-af3f3f7b1415 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:32:55.997368 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-4936453f-0807-440c-8897-af3f3f7b1415 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:32:56.004319 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4936453f-0807-440c-8897-af3f3f7b1415 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:56.005014 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4936453f-0807-440c-8897-af3f3f7b1415 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:56.005787 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4936453f-0807-440c-8897-af3f3f7b1415 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:56.006228 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4936453f-0807-440c-8897-af3f3f7b1415 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:56.133172 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-4936453f-0807-440c-8897-af3f3f7b1415 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:56.141617 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-4936453f-0807-440c-8897-af3f3f7b1415 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:56.143133 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-4936453f-0807-440c-8897-af3f3f7b1415 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:56.144286 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-4936453f-0807-440c-8897-af3f3f7b1415 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1406 microversion: 2.20 time: 0.151943 May 28 17:32:56.144844 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 421/829] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:32:55 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:32:57.162702 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0271a266-940a-4990-ac48-887f6ed7c64e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:32:57.163199 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0271a266-940a-4990-ac48-887f6ed7c64e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:32:57.170420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0271a266-940a-4990-ac48-887f6ed7c64e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:57.170873 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0271a266-940a-4990-ac48-887f6ed7c64e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:57.172518 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0271a266-940a-4990-ac48-887f6ed7c64e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:57.172970 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0271a266-940a-4990-ac48-887f6ed7c64e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:57.309626 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0271a266-940a-4990-ac48-887f6ed7c64e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:57.318716 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0271a266-940a-4990-ac48-887f6ed7c64e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:57.320366 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0271a266-940a-4990-ac48-887f6ed7c64e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:57.321555 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0271a266-940a-4990-ac48-887f6ed7c64e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1406 microversion: 2.20 time: 0.162851 May 28 17:32:57.322124 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 409/830] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:32:57 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:32:58.340320 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b1caa376-6862-472c-b540-b58908286c25 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:32:58.340927 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b1caa376-6862-472c-b540-b58908286c25 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:32:58.348291 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b1caa376-6862-472c-b540-b58908286c25 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:58.348736 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b1caa376-6862-472c-b540-b58908286c25 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:58.349495 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b1caa376-6862-472c-b540-b58908286c25 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:58.349927 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b1caa376-6862-472c-b540-b58908286c25 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:58.478314 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b1caa376-6862-472c-b540-b58908286c25 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:58.481776 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:32:58.487434 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b1caa376-6862-472c-b540-b58908286c25 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:58.488938 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b1caa376-6862-472c-b540-b58908286c25 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:58.490053 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b1caa376-6862-472c-b540-b58908286c25 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1406 microversion: 2.20 time: 0.153629 May 28 17:32:58.490615 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 422/831] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:32:58 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:32:59.508082 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-13f884d0-00a1-4b2f-81ab-10e0cefa340b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:32:59.508800 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-13f884d0-00a1-4b2f-81ab-10e0cefa340b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:32:59.511201 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:32:59.517360 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-13f884d0-00a1-4b2f-81ab-10e0cefa340b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:59.517806 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-13f884d0-00a1-4b2f-81ab-10e0cefa340b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:59.518556 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-13f884d0-00a1-4b2f-81ab-10e0cefa340b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:59.518988 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-13f884d0-00a1-4b2f-81ab-10e0cefa340b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:59.522590 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:32:59.649149 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-13f884d0-00a1-4b2f-81ab-10e0cefa340b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:59.657818 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-13f884d0-00a1-4b2f-81ab-10e0cefa340b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:59.659262 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-13f884d0-00a1-4b2f-81ab-10e0cefa340b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:32:59.660395 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-13f884d0-00a1-4b2f-81ab-10e0cefa340b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1406 microversion: 2.20 time: 0.156476 May 28 17:32:59.660944 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 410/832] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:32:59 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:32:59.901419 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-0233efb5-03c7-40f2-bb62-9906fa09e84c req-b6d83c81-77dc-4936-8dce-92993030e9a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27322ac4-8704-4f1a-b431-e5c4ad7d77ad", "name": "network-vif-plugged", "status": "completed", "tag": "e951fe87-910c-4495-88e9-a876c275be25"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:32:59.911614 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-0233efb5-03c7-40f2-bb62-9906fa09e84c req-b6d83c81-77dc-4936-8dce-92993030e9a2 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:32:59.912122 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-0233efb5-03c7-40f2-bb62-9906fa09e84c req-b6d83c81-77dc-4936-8dce-92993030e9a2 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:32:59.923723 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-0233efb5-03c7-40f2-bb62-9906fa09e84c req-b6d83c81-77dc-4936-8dce-92993030e9a2 service nova] Creating event network-vif-plugged:e951fe87-910c-4495-88e9-a876c275be25 for instance 27322ac4-8704-4f1a-b431-e5c4ad7d77ad on hv-cinder-84372 May 28 17:32:59.928384 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-0233efb5-03c7-40f2-bb62-9906fa09e84c req-b6d83c81-77dc-4936-8dce-92993030e9a2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031522 May 28 17:32:59.928969 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 423/833] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:33:00.678337 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-30eb4eff-6873-4b65-84c6-e1ccad459f5a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:00.678859 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-30eb4eff-6873-4b65-84c6-e1ccad459f5a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:00.685291 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-30eb4eff-6873-4b65-84c6-e1ccad459f5a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:00.685744 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-30eb4eff-6873-4b65-84c6-e1ccad459f5a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:00.686507 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-30eb4eff-6873-4b65-84c6-e1ccad459f5a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:00.687555 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-30eb4eff-6873-4b65-84c6-e1ccad459f5a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:00.815225 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-30eb4eff-6873-4b65-84c6-e1ccad459f5a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:00.823054 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-30eb4eff-6873-4b65-84c6-e1ccad459f5a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:00.824578 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-30eb4eff-6873-4b65-84c6-e1ccad459f5a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:00.825675 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-30eb4eff-6873-4b65-84c6-e1ccad459f5a tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1406 microversion: 2.20 time: 0.151372 May 28 17:33:00.826228 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 411/834] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:33:00 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:33:01.841355 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:33:01.842027 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=6 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:33:01.846503 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c462635f-93fb-44d9-bf2b-aa01e7293bc5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:01.847200 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c462635f-93fb-44d9-bf2b-aa01e7293bc5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:01.849049 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:33:01.855643 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c462635f-93fb-44d9-bf2b-aa01e7293bc5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:01.856093 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c462635f-93fb-44d9-bf2b-aa01e7293bc5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:01.856852 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c462635f-93fb-44d9-bf2b-aa01e7293bc5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:01.857289 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c462635f-93fb-44d9-bf2b-aa01e7293bc5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:01.986509 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c462635f-93fb-44d9-bf2b-aa01e7293bc5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:01.994407 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c462635f-93fb-44d9-bf2b-aa01e7293bc5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:01.995940 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c462635f-93fb-44d9-bf2b-aa01e7293bc5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:01.997046 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c462635f-93fb-44d9-bf2b-aa01e7293bc5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1406 microversion: 2.20 time: 0.157178 May 28 17:33:01.997605 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 424/835] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:33:01 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:33:03.016767 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c68b6dd9-c4d9-4e21-afd7-3758a285428c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:03.017377 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c68b6dd9-c4d9-4e21-afd7-3758a285428c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:03.019546 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=6 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:33:03.027634 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c68b6dd9-c4d9-4e21-afd7-3758a285428c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:03.028330 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c68b6dd9-c4d9-4e21-afd7-3758a285428c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:03.029106 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c68b6dd9-c4d9-4e21-afd7-3758a285428c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:03.029541 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c68b6dd9-c4d9-4e21-afd7-3758a285428c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:03.423014 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c68b6dd9-c4d9-4e21-afd7-3758a285428c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:03.431246 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c68b6dd9-c4d9-4e21-afd7-3758a285428c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:03.433010 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c68b6dd9-c4d9-4e21-afd7-3758a285428c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:03.434187 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c68b6dd9-c4d9-4e21-afd7-3758a285428c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1599 microversion: 2.20 time: 0.421858 May 28 17:33:03.434753 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 412/836] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:33:03 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1599 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:33:03.452652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-bc262a90-b9e1-4800-990f-cc026387697e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:03.453805 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-bc262a90-b9e1-4800-990f-cc026387697e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:03.460584 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bc262a90-b9e1-4800-990f-cc026387697e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:03.461033 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bc262a90-b9e1-4800-990f-cc026387697e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:03.461813 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bc262a90-b9e1-4800-990f-cc026387697e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:03.462273 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bc262a90-b9e1-4800-990f-cc026387697e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:03.550782 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-bc262a90-b9e1-4800-990f-cc026387697e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.103069 May 28 17:33:03.551490 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 425/837] 10.222.0.33 () {60 vars in 1315 bytes} [Sat May 28 17:33:03 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 17:33:03.669170 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-46b5b857-18a4-4419-8934-163ff2c46a90 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:03.670410 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-46b5b857-18a4-4419-8934-163ff2c46a90 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:03.678450 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-46b5b857-18a4-4419-8934-163ff2c46a90 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:03.678901 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-46b5b857-18a4-4419-8934-163ff2c46a90 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:03.679701 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-46b5b857-18a4-4419-8934-163ff2c46a90 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:03.680136 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-46b5b857-18a4-4419-8934-163ff2c46a90 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:03.710651 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-46b5b857-18a4-4419-8934-163ff2c46a90 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045916 May 28 17:33:03.711462 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 413/838] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 17:33:03 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 17:33:03.769970 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-77beec0e-2a86-445e-abdc-3274a33c12e2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:03.770471 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-77beec0e-2a86-445e-abdc-3274a33c12e2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:03.778601 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-77beec0e-2a86-445e-abdc-3274a33c12e2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:03.779409 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-77beec0e-2a86-445e-abdc-3274a33c12e2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:03.781347 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-77beec0e-2a86-445e-abdc-3274a33c12e2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:03.782143 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-77beec0e-2a86-445e-abdc-3274a33c12e2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:03.811958 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-77beec0e-2a86-445e-abdc-3274a33c12e2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Going to try to terminate instance {{(pid=117604) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 17:33:03.898986 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-77beec0e-2a86-445e-abdc-3274a33c12e2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 204 len: 0 microversion: 2.1 time: 0.132776 May 28 17:33:03.899524 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 426/839] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 17:33:03 2022] DELETE /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 17:33:03.908314 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0d6293d3-d528-4462-b190-0de4c6c4989c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:03.909016 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0d6293d3-d528-4462-b190-0de4c6c4989c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:03.915803 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0d6293d3-d528-4462-b190-0de4c6c4989c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:03.916278 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0d6293d3-d528-4462-b190-0de4c6c4989c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:03.917089 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0d6293d3-d528-4462-b190-0de4c6c4989c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:03.917532 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0d6293d3-d528-4462-b190-0de4c6c4989c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:04.048319 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0d6293d3-d528-4462-b190-0de4c6c4989c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:04.056044 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0d6293d3-d528-4462-b190-0de4c6c4989c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1672 microversion: 2.1 time: 0.152006 May 28 17:33:04.056607 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 414/840] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:03 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:33:04.513040 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-57c8d245-3199-4b71-a6b8-4ea4fffd399e req-ce5a3441-3014-4bcd-8c1c-09de9ea5b1c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27322ac4-8704-4f1a-b431-e5c4ad7d77ad", "tag": "e951fe87-910c-4495-88e9-a876c275be25"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:33:04.521739 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-57c8d245-3199-4b71-a6b8-4ea4fffd399e req-ce5a3441-3014-4bcd-8c1c-09de9ea5b1c4 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:04.522175 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-57c8d245-3199-4b71-a6b8-4ea4fffd399e req-ce5a3441-3014-4bcd-8c1c-09de9ea5b1c4 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:04.535510 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-57c8d245-3199-4b71-a6b8-4ea4fffd399e req-ce5a3441-3014-4bcd-8c1c-09de9ea5b1c4 service nova] Creating event network-changed:e951fe87-910c-4495-88e9-a876c275be25 for instance 27322ac4-8704-4f1a-b431-e5c4ad7d77ad on hv-cinder-84372 May 28 17:33:04.540325 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-57c8d245-3199-4b71-a6b8-4ea4fffd399e req-ce5a3441-3014-4bcd-8c1c-09de9ea5b1c4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031333 May 28 17:33:04.540912 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 427/841] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:33:05.074053 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6e38f9d7-5bd3-4c51-af98-0b6a6e10efde tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:05.074910 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6e38f9d7-5bd3-4c51-af98-0b6a6e10efde tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:05.082108 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6e38f9d7-5bd3-4c51-af98-0b6a6e10efde tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:05.082635 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6e38f9d7-5bd3-4c51-af98-0b6a6e10efde tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:05.083537 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6e38f9d7-5bd3-4c51-af98-0b6a6e10efde tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:05.084074 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6e38f9d7-5bd3-4c51-af98-0b6a6e10efde tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:05.221767 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-6e38f9d7-5bd3-4c51-af98-0b6a6e10efde tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:05.229680 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6e38f9d7-5bd3-4c51-af98-0b6a6e10efde tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1672 microversion: 2.1 time: 0.159499 May 28 17:33:05.230464 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 415/842] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:05 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:06.247513 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2b78c8c4-9f2f-4ee5-ba58-6b7d6e62c009 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:06.248826 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2b78c8c4-9f2f-4ee5-ba58-6b7d6e62c009 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:06.256257 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2b78c8c4-9f2f-4ee5-ba58-6b7d6e62c009 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:06.257249 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2b78c8c4-9f2f-4ee5-ba58-6b7d6e62c009 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:06.260204 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2b78c8c4-9f2f-4ee5-ba58-6b7d6e62c009 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:06.260996 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2b78c8c4-9f2f-4ee5-ba58-6b7d6e62c009 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:06.324381 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-70ae72dc-4a48-48b2-b717-5553ffd0fe5c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:06.324913 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-70ae72dc-4a48-48b2-b717-5553ffd0fe5c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:06.332245 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-70ae72dc-4a48-48b2-b717-5553ffd0fe5c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:06.333254 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-70ae72dc-4a48-48b2-b717-5553ffd0fe5c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:06.334272 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-70ae72dc-4a48-48b2-b717-5553ffd0fe5c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:06.334932 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-70ae72dc-4a48-48b2-b717-5553ffd0fe5c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:06.341674 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-2b78c8c4-9f2f-4ee5-ba58-6b7d6e62c009 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:06.350840 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2b78c8c4-9f2f-4ee5-ba58-6b7d6e62c009 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 200 len: 1604 microversion: 2.1 time: 0.108010 May 28 17:33:06.351665 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 428/843] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:06 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 1604 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:06.443538 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-70ae72dc-4a48-48b2-b717-5553ffd0fe5c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lazy-loading 'services' on Instance uuid 435314f8-f9b7-4e9c-94f3-8a84190965b9 {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 17:33:06.525646 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-70ae72dc-4a48-48b2-b717-5553ffd0fe5c tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "DELETE /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9/os-volume_attachments/465869b4-b705-4b7e-8b8f-31b1e46391b9" status: 202 len: 0 microversion: 2.1 time: 0.204162 May 28 17:33:06.526673 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 416/844] 10.222.0.33 () {58 vars in 1415 bytes} [Sat May 28 17:33:06 2022] DELETE /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9/os-volume_attachments/465869b4-b705-4b7e-8b8f-31b1e46391b9 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 17:33:06.535831 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e6a421e2-7733-4541-b2b7-349ffa235809 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:06.536806 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e6a421e2-7733-4541-b2b7-349ffa235809 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:06.542713 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e6a421e2-7733-4541-b2b7-349ffa235809 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:06.543175 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e6a421e2-7733-4541-b2b7-349ffa235809 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:06.543980 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e6a421e2-7733-4541-b2b7-349ffa235809 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:06.544455 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e6a421e2-7733-4541-b2b7-349ffa235809 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:06.557427 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-d16c2c77-5fe7-43ea-a09d-04a0bef9837e req-730d6284-b7f4-4ca1-95d9-777ba37627dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b3c1f29-31c9-4f5c-9875-fd1939062512", "name": "network-vif-deleted", "tag": "d234e00a-5520-40b5-aa3f-c3a3f2a506ee"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:33:06.568925 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-d16c2c77-5fe7-43ea-a09d-04a0bef9837e req-730d6284-b7f4-4ca1-95d9-777ba37627dd service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:06.569465 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-d16c2c77-5fe7-43ea-a09d-04a0bef9837e req-730d6284-b7f4-4ca1-95d9-777ba37627dd service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:06.582041 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e6a421e2-7733-4541-b2b7-349ffa235809 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050370 May 28 17:33:06.582630 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 429/845] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 17:33:06 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:33:06.582789 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-d16c2c77-5fe7-43ea-a09d-04a0bef9837e req-730d6284-b7f4-4ca1-95d9-777ba37627dd service nova] Creating event network-vif-deleted:d234e00a-5520-40b5-aa3f-c3a3f2a506ee for instance 3b3c1f29-31c9-4f5c-9875-fd1939062512 on hv-cinder-84372 May 28 17:33:06.587639 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-d16c2c77-5fe7-43ea-a09d-04a0bef9837e req-730d6284-b7f4-4ca1-95d9-777ba37627dd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034446 May 28 17:33:06.588378 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 417/846] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:33:07.370158 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-21eae9f4-728a-4984-b46f-ade73b65afd8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:07.370728 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-21eae9f4-728a-4984-b46f-ade73b65afd8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:07.378101 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-21eae9f4-728a-4984-b46f-ade73b65afd8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:07.378771 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-21eae9f4-728a-4984-b46f-ade73b65afd8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:07.379560 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-21eae9f4-728a-4984-b46f-ade73b65afd8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:07.380009 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-21eae9f4-728a-4984-b46f-ade73b65afd8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:07.394646 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-21eae9f4-728a-4984-b46f-ade73b65afd8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] HTTP exception thrown: Instance 3b3c1f29-31c9-4f5c-9875-fd1939062512 could not be found. May 28 17:33:07.396338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-21eae9f4-728a-4984-b46f-ade73b65afd8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Request method failure captured: May 28 17:33:07.396338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 HTTP/1.1 May 28 17:33:07.396338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:33:07.396338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:33:07.396338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:33:07.396338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 0 May 28 17:33:07.396338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:33:07.396338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:33:07.396338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:33:07.396338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:33:07.396338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABiklsQwaALxIpoi-IQH5ulhomUzFtt0EHGvqFk34aslFHgcc8sGBZCHK9ucNqV3kceChC4qsoegwSUz42jW60ch9icnM2zXQM0e-3SG5KJN4XJR0zFETmt9esiUnyT2CHSaBoujBd1aDkt7nYWHIo-UDHEDTjlbPZknmx1CMAICvmILgM May 28 17:33:07.396338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:33:07.396338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:33:07.396338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:33:07.396338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:33:07.396338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:33:07.396338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:33:07.396338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: 90b378551d1c467e911cf01274c97d85 May 28 17:33:07.396338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-AttachVolumeTestJSON-1064743775 May 28 17:33:07.396338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:33:07.396338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:33:07.397699 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90b378551d1c467e911cf01274c97d85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90b378551d1c467e911cf01274c97d85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/90b378551d1c467e911cf01274c97d85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_90b378551d1c467e911cf01274c97d85", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:33:07.397699 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-AttachVolumeTestJSON-1064743775 May 28 17:33:07.397699 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 90b378551d1c467e911cf01274c97d85 May 28 17:33:07.397699 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1064743775 May 28 17:33:07.397699 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-AttachVolumeTestJSON-1064743775-project May 28 17:33:07.397699 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:33:07.397699 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:33:07.397699 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: 7fcc62869ac34381a2327be46511137b May 28 17:33:07.397699 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-AttachVolumeTestJSON-1064743775-project May 28 17:33:07.397699 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: > May 28 17:33:07.397699 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Instance 3b3c1f29-31c9-4f5c-9875-fd1939062512 could not be found. May 28 17:33:07.397699 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'id': '3b3c1f29-31c9-4f5c-9875-fd1939062512'} May 28 17:33:07.399151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:33:07.399151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:33:07.399151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:33:07.399151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:33:07.399151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:33:07.399151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:33:07.399151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:33:07.399151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:33:07.399151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:33:07.399151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:33:07.399151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b3c1f29-31c9-4f5c-9875-fd1939062512 could not be found. May 28 17:33:07.399151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:33:07.399151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:33:07.399151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:33:07.399151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:33:07.399151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:33:07.399151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:33:07.399151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:33:07.399151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:33:07.399151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:33:07.401519 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:33:07.401519 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:33:07.401519 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:33:07.401519 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:33:07.401519 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:33:07.401519 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:33:07.401519 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:33:07.401519 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b3c1f29-31c9-4f5c-9875-fd1939062512 could not be found. May 28 17:33:07.401519 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:33:07.401519 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:33:07.401519 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:33:07.401519 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:33:07.401519 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:33:07.401519 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:33:07.401519 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:33:07.401519 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:33:07.401519 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b3c1f29-31c9-4f5c-9875-fd1939062512 could not be found. May 28 17:33:07.401519 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:33:07.402936 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-21eae9f4-728a-4984-b46f-ade73b65afd8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Returning 404 to user: Instance 3b3c1f29-31c9-4f5c-9875-fd1939062512 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:33:07.402936 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-21eae9f4-728a-4984-b46f-ade73b65afd8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 404 len: 111 microversion: 2.1 time: 0.032346 May 28 17:33:07.402936 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 430/847] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:07 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:33:07.411975 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-090ba32e-c17d-48fd-9183-b0ef8365dc07 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '.version_select at 0x7f9efc1c4670>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:07.437286 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-090ba32e-c17d-48fd-9183-b0ef8365dc07 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-824016868" status: 202 len: 0 microversion: 2.1 time: 0.032055 May 28 17:33:07.438044 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 418/848] 10.222.0.33 () {58 vars in 1217 bytes} [Sat May 28 17:33:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-824016868 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 17:33:07.595890 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f32089ec-8c75-41e4-bbf3-4b649d693124 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:07.597422 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f32089ec-8c75-41e4-bbf3-4b649d693124 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:07.604507 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f32089ec-8c75-41e4-bbf3-4b649d693124 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:07.604983 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f32089ec-8c75-41e4-bbf3-4b649d693124 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:07.605760 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f32089ec-8c75-41e4-bbf3-4b649d693124 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:07.606208 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f32089ec-8c75-41e4-bbf3-4b649d693124 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:07.647240 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f32089ec-8c75-41e4-bbf3-4b649d693124 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057334 May 28 17:33:07.648470 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 431/849] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 17:33:07 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:33:08.089758 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e0b94e6d-e56d-42d9-bebc-2c6dc8e5383e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Action: 'create', calling method: .version_select at 0x7f9efc18b550>, body: {"keypair": {"name": "tempest-keypair-361195865", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBExdFd41T+0CyAj/Rsw+Dqm0S+7jy3NCw4YKCJo73QOjWX7nAm0GkXWkWIoLaEBlUsgOsOu1q7jCF+/yPT5l1wT6UQZpSKo5Z6Ip2cKajzAhYc7lYrpnDiNpOhmEPQJTA=="}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:33:08.104159 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-e0b94e6d-e56d-42d9-bebc-2c6dc8e5383e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Getting quotas for project 90b378551d1c467e911cf01274c97d85. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:33:08.107930 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-e0b94e6d-e56d-42d9-bebc-2c6dc8e5383e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Getting quotas for user 7fcc62869ac34381a2327be46511137b and project 90b378551d1c467e911cf01274c97d85. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:33:08.131021 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-e0b94e6d-e56d-42d9-bebc-2c6dc8e5383e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045685 May 28 17:33:08.131661 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 419/850] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 17:33:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:33:08.658259 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e9a01ba9-9844-4364-8add-2917dbd7cff4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:08.659258 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e9a01ba9-9844-4364-8add-2917dbd7cff4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:08.665685 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e9a01ba9-9844-4364-8add-2917dbd7cff4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:08.666132 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e9a01ba9-9844-4364-8add-2917dbd7cff4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:08.666900 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e9a01ba9-9844-4364-8add-2917dbd7cff4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:08.667361 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e9a01ba9-9844-4364-8add-2917dbd7cff4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:08.696100 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e9a01ba9-9844-4364-8add-2917dbd7cff4 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041868 May 28 17:33:08.696653 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 432/851] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 17:33:08 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 17:33:08.769867 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d8420c21-f49b-48f8-8d0c-beae69b98525 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:08.770560 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d8420c21-f49b-48f8-8d0c-beae69b98525 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:08.777189 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d8420c21-f49b-48f8-8d0c-beae69b98525 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:08.777645 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d8420c21-f49b-48f8-8d0c-beae69b98525 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:08.778416 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d8420c21-f49b-48f8-8d0c-beae69b98525 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:08.778861 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d8420c21-f49b-48f8-8d0c-beae69b98525 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:08.808004 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d8420c21-f49b-48f8-8d0c-beae69b98525 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Going to try to terminate instance {{(pid=117605) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 17:33:08.893930 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d8420c21-f49b-48f8-8d0c-beae69b98525 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "DELETE /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 204 len: 0 microversion: 2.1 time: 0.127719 May 28 17:33:08.894658 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 420/852] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 17:33:08 2022] DELETE /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 17:33:08.904251 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a4fc1218-cd16-4e82-ab01-13784cef75b1 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:08.904782 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a4fc1218-cd16-4e82-ab01-13784cef75b1 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:08.914359 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a4fc1218-cd16-4e82-ab01-13784cef75b1 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:08.915036 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a4fc1218-cd16-4e82-ab01-13784cef75b1 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:08.915846 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a4fc1218-cd16-4e82-ab01-13784cef75b1 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:08.916287 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a4fc1218-cd16-4e82-ab01-13784cef75b1 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:09.049045 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a4fc1218-cd16-4e82-ab01-13784cef75b1 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:09.056678 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a4fc1218-cd16-4e82-ab01-13784cef75b1 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1688 microversion: 2.1 time: 0.157573 May 28 17:33:09.057236 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 433/853] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:08 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:09.412146 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c5392639-16c8-4ca0-a21f-354bacf33b95 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-974627557", "imageRef": "b2aab55c-a793-472a-bc32-81af689ad609", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ef03f64f-43e2-4121-9b36-bf95e66e6156"}], "security_groups": [{"name": "tempest-securitygroup--837178486"}], "key_name": "tempest-keypair-361195865", "user_data": "}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:33:09.512779 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.network.neutron [None req-c5392639-16c8-4ca0-a21f-354bacf33b95 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] validate_networks() for [('ef03f64f-43e2-4121-9b36-bf95e66e6156', None, None, None, None, None)] {{(pid=117605) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 17:33:09.877211 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-c5392639-16c8-4ca0-a21f-354bacf33b95 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Flavor limits 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 17:33:09.877976 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-c5392639-16c8-4ca0-a21f-354bacf33b95 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Image limits 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 17:33:09.878094 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-c5392639-16c8-4ca0-a21f-354bacf33b95 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Flavor pref 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 17:33:09.878515 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-c5392639-16c8-4ca0-a21f-354bacf33b95 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Image pref 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 17:33:09.878925 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-c5392639-16c8-4ca0-a21f-354bacf33b95 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 17:33:09.887925 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c5392639-16c8-4ca0-a21f-354bacf33b95 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:09.888370 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c5392639-16c8-4ca0-a21f-354bacf33b95 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:09.889163 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c5392639-16c8-4ca0-a21f-354bacf33b95 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:09.889623 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c5392639-16c8-4ca0-a21f-354bacf33b95 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:09.906791 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-c5392639-16c8-4ca0-a21f-354bacf33b95 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Getting quotas for project 90b378551d1c467e911cf01274c97d85. Resources: {'instances', 'cores', 'ram'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:33:09.910674 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-c5392639-16c8-4ca0-a21f-354bacf33b95 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Getting quotas for user 7fcc62869ac34381a2327be46511137b and project 90b378551d1c467e911cf01274c97d85. Resources: {'instances', 'cores', 'ram'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:33:09.921476 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c5392639-16c8-4ca0-a21f-354bacf33b95 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Going to run 1 instances... {{(pid=117605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 17:33:09.923941 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c5392639-16c8-4ca0-a21f-354bacf33b95 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b2aab55c-a793-472a-bc32-81af689ad609',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 17:33:09.969397 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c5392639-16c8-4ca0-a21f-354bacf33b95 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.561857 May 28 17:33:09.970138 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 421/854] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 17:33:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 17:33:09.980213 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d24708f2-2190-4a86-8085-18f1f704e6c5 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:09.980832 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d24708f2-2190-4a86-8085-18f1f704e6c5 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:10.034007 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d24708f2-2190-4a86-8085-18f1f704e6c5 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:10.040808 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d24708f2-2190-4a86-8085-18f1f704e6c5 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2" status: 200 len: 1236 microversion: 2.1 time: 0.064446 May 28 17:33:10.041525 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 434/855] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:09 2022] GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2 => generated 1236 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:10.074093 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-527e582e-bd13-4285-98d7-95d588dba934 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:10.074712 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-527e582e-bd13-4285-98d7-95d588dba934 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:10.082349 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-527e582e-bd13-4285-98d7-95d588dba934 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:10.082806 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-527e582e-bd13-4285-98d7-95d588dba934 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:10.083620 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-527e582e-bd13-4285-98d7-95d588dba934 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:10.084032 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-527e582e-bd13-4285-98d7-95d588dba934 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:10.220214 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-527e582e-bd13-4285-98d7-95d588dba934 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:10.227724 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-527e582e-bd13-4285-98d7-95d588dba934 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1688 microversion: 2.1 time: 0.157429 May 28 17:33:10.228294 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 422/856] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:10 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:11.057781 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b0d8b2fc-a245-41c5-9d16-f9da3c721945 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:11.058393 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b0d8b2fc-a245-41c5-9d16-f9da3c721945 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:11.066545 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b0d8b2fc-a245-41c5-9d16-f9da3c721945 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:11.067022 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b0d8b2fc-a245-41c5-9d16-f9da3c721945 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:11.067833 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b0d8b2fc-a245-41c5-9d16-f9da3c721945 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:11.068273 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b0d8b2fc-a245-41c5-9d16-f9da3c721945 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:11.126907 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b0d8b2fc-a245-41c5-9d16-f9da3c721945 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:11.134458 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b0d8b2fc-a245-41c5-9d16-f9da3c721945 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2" status: 200 len: 1240 microversion: 2.1 time: 0.080545 May 28 17:33:11.135008 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 435/857] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:11 2022] GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2 => generated 1240 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:11.245240 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-bc8757f2-b09d-451c-ad83-e9ba0b52d6eb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:11.245826 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-bc8757f2-b09d-451c-ad83-e9ba0b52d6eb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:11.252824 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bc8757f2-b09d-451c-ad83-e9ba0b52d6eb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:11.253271 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bc8757f2-b09d-451c-ad83-e9ba0b52d6eb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:11.254024 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bc8757f2-b09d-451c-ad83-e9ba0b52d6eb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:11.254456 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bc8757f2-b09d-451c-ad83-e9ba0b52d6eb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:11.384590 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bc8757f2-b09d-451c-ad83-e9ba0b52d6eb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:11.392028 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-bc8757f2-b09d-451c-ad83-e9ba0b52d6eb tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1688 microversion: 2.1 time: 0.150645 May 28 17:33:11.392593 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 423/858] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:11 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:33:12.151762 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-59d5b650-20fa-4eb1-8935-36ec5d3e879b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:12.152318 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-59d5b650-20fa-4eb1-8935-36ec5d3e879b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:12.159930 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-59d5b650-20fa-4eb1-8935-36ec5d3e879b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:12.160652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-59d5b650-20fa-4eb1-8935-36ec5d3e879b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:12.161422 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-59d5b650-20fa-4eb1-8935-36ec5d3e879b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:12.162053 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-59d5b650-20fa-4eb1-8935-36ec5d3e879b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:12.225938 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-59d5b650-20fa-4eb1-8935-36ec5d3e879b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:12.234114 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-59d5b650-20fa-4eb1-8935-36ec5d3e879b tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2" status: 200 len: 1288 microversion: 2.1 time: 0.086222 May 28 17:33:12.234995 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 436/859] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:12 2022] GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2 => generated 1288 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:12.409647 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2e9994f2-c94a-4f55-bf8b-a3e4ba536692 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:12.410186 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2e9994f2-c94a-4f55-bf8b-a3e4ba536692 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:12.416972 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2e9994f2-c94a-4f55-bf8b-a3e4ba536692 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:12.417425 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2e9994f2-c94a-4f55-bf8b-a3e4ba536692 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:12.418189 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2e9994f2-c94a-4f55-bf8b-a3e4ba536692 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:12.418675 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2e9994f2-c94a-4f55-bf8b-a3e4ba536692 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:12.557474 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2e9994f2-c94a-4f55-bf8b-a3e4ba536692 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:12.564936 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2e9994f2-c94a-4f55-bf8b-a3e4ba536692 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1688 microversion: 2.1 time: 0.159810 May 28 17:33:12.565502 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 424/860] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:12 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:13.253715 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-69f8d6f8-1f22-4136-b5b7-1a6cb7e0268e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:13.254914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-69f8d6f8-1f22-4136-b5b7-1a6cb7e0268e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:13.262106 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-69f8d6f8-1f22-4136-b5b7-1a6cb7e0268e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:13.262868 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-69f8d6f8-1f22-4136-b5b7-1a6cb7e0268e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:13.263888 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-69f8d6f8-1f22-4136-b5b7-1a6cb7e0268e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:13.265075 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-69f8d6f8-1f22-4136-b5b7-1a6cb7e0268e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:13.355688 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-69f8d6f8-1f22-4136-b5b7-1a6cb7e0268e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:13.364141 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-69f8d6f8-1f22-4136-b5b7-1a6cb7e0268e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2" status: 200 len: 1294 microversion: 2.1 time: 0.116485 May 28 17:33:13.364809 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 437/861] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:13 2022] GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2 => generated 1294 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:13.559219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-c4b51a8c-f2b6-49af-b0c6-28e84f7d932b req-4fd5d530-f717-4a73-8ebe-df208f37ca56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "435314f8-f9b7-4e9c-94f3-8a84190965b9", "name": "network-vif-deleted", "tag": "5ea754ee-2216-4168-ad09-190faba5d36c"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:33:13.584665 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-c4b51a8c-f2b6-49af-b0c6-28e84f7d932b req-4fd5d530-f717-4a73-8ebe-df208f37ca56 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:13.588196 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-195c6dd0-1e37-4980-9205-9bff190c3b6d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:13.589205 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-195c6dd0-1e37-4980-9205-9bff190c3b6d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:13.596996 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-c4b51a8c-f2b6-49af-b0c6-28e84f7d932b req-4fd5d530-f717-4a73-8ebe-df208f37ca56 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:13.603980 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-195c6dd0-1e37-4980-9205-9bff190c3b6d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:13.604808 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-195c6dd0-1e37-4980-9205-9bff190c3b6d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:13.608340 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-195c6dd0-1e37-4980-9205-9bff190c3b6d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:13.609303 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-195c6dd0-1e37-4980-9205-9bff190c3b6d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:13.637166 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-c4b51a8c-f2b6-49af-b0c6-28e84f7d932b req-4fd5d530-f717-4a73-8ebe-df208f37ca56 service nova] Creating event network-vif-deleted:5ea754ee-2216-4168-ad09-190faba5d36c for instance 435314f8-f9b7-4e9c-94f3-8a84190965b9 on hv-cinder-84372 May 28 17:33:13.648889 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-c4b51a8c-f2b6-49af-b0c6-28e84f7d932b req-4fd5d530-f717-4a73-8ebe-df208f37ca56 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091981 May 28 17:33:13.654517 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 425/862] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:33:13.762907 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-195c6dd0-1e37-4980-9205-9bff190c3b6d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:13.774858 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-195c6dd0-1e37-4980-9205-9bff190c3b6d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 200 len: 1330 microversion: 2.1 time: 0.195208 May 28 17:33:13.785020 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 438/863] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:13 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 1330 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:14.381476 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2c9588c9-b94d-4729-8efb-3f1c871f174e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:14.382189 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2c9588c9-b94d-4729-8efb-3f1c871f174e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:14.389155 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2c9588c9-b94d-4729-8efb-3f1c871f174e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:14.390110 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2c9588c9-b94d-4729-8efb-3f1c871f174e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:14.391262 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2c9588c9-b94d-4729-8efb-3f1c871f174e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:14.391939 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2c9588c9-b94d-4729-8efb-3f1c871f174e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:14.489409 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-2118d268-4caa-4dd8-b9bf-694c9c239892 req-aaa70f5d-668d-4cfc-bf48-1d472c01ebfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ab8f789-f8ff-4804-bfcb-3e1d600943b2", "tag": "ec8a6a71-b7c9-479a-9c50-6bdafed86a1d"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:33:14.501465 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-2118d268-4caa-4dd8-b9bf-694c9c239892 req-aaa70f5d-668d-4cfc-bf48-1d472c01ebfa service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:14.502661 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-2118d268-4caa-4dd8-b9bf-694c9c239892 req-aaa70f5d-668d-4cfc-bf48-1d472c01ebfa service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:14.520417 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-2118d268-4caa-4dd8-b9bf-694c9c239892 req-aaa70f5d-668d-4cfc-bf48-1d472c01ebfa service nova] Creating event network-changed:ec8a6a71-b7c9-479a-9c50-6bdafed86a1d for instance 4ab8f789-f8ff-4804-bfcb-3e1d600943b2 on hv-cinder-84372 May 28 17:33:14.543871 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-2118d268-4caa-4dd8-b9bf-694c9c239892 req-aaa70f5d-668d-4cfc-bf48-1d472c01ebfa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058121 May 28 17:33:14.545145 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 439/864] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:33:14.660928 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2c9588c9-b94d-4729-8efb-3f1c871f174e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:14.671488 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2c9588c9-b94d-4729-8efb-3f1c871f174e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2" status: 200 len: 1361 microversion: 2.1 time: 0.293525 May 28 17:33:14.675671 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 426/865] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:14 2022] GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2 => generated 1361 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:14.792479 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-cf5ae2b1-b524-4b5f-aa77-ba325d88e17e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:14.793282 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-cf5ae2b1-b524-4b5f-aa77-ba325d88e17e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 435314f8-f9b7-4e9c-94f3-8a84190965b9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:14.800115 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cf5ae2b1-b524-4b5f-aa77-ba325d88e17e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:14.800653 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cf5ae2b1-b524-4b5f-aa77-ba325d88e17e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:14.801679 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cf5ae2b1-b524-4b5f-aa77-ba325d88e17e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:14.802186 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cf5ae2b1-b524-4b5f-aa77-ba325d88e17e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:14.816122 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-cf5ae2b1-b524-4b5f-aa77-ba325d88e17e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] HTTP exception thrown: Instance 435314f8-f9b7-4e9c-94f3-8a84190965b9 could not be found. May 28 17:33:14.817849 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-cf5ae2b1-b524-4b5f-aa77-ba325d88e17e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Request method failure captured: May 28 17:33:14.817849 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 HTTP/1.1 May 28 17:33:14.817849 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:33:14.817849 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:33:14.817849 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:33:14.817849 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 0 May 28 17:33:14.817849 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:33:14.817849 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:33:14.817849 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:33:14.817849 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:33:14.817849 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABiklsVPAofKmWg7pU3upj-M8izgby3MaGFgVfx3qysxJVQ7MR6rPa0rRZjJHfi41WGdE8TyYIJQQX0sUjsJLH8BfsxgRgGUV9qPuOrFObQ92QtyvsoGrvxn8VvrbGoJALWgEDz40ZCH_F7fvXkHWOXkwKXZd7Bop_F5hWOJ0OEwQXIUYI May 28 17:33:14.817849 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:33:14.817849 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:33:14.817849 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:33:14.817849 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:33:14.817849 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:33:14.817849 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:33:14.817849 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: 8e92a5dc387f47c99ce98da4d6fd9d92 May 28 17:33:14.817849 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1728494172 May 28 17:33:14.817849 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:33:14.817849 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:33:14.820489 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8e92a5dc387f47c99ce98da4d6fd9d92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8e92a5dc387f47c99ce98da4d6fd9d92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8e92a5dc387f47c99ce98da4d6fd9d92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8e92a5dc387f47c99ce98da4d6fd9d92", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:33:14.820489 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1728494172 May 28 17:33:14.820489 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 8e92a5dc387f47c99ce98da4d6fd9d92 May 28 17:33:14.820489 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1728494172 May 28 17:33:14.820489 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-ServerRescueNegativeTestJSON-1728494172-project May 28 17:33:14.820489 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:33:14.820489 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:33:14.820489 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: 927f21ef1ca74ec58f85181728933e82 May 28 17:33:14.820489 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1728494172-project May 28 17:33:14.820489 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: > May 28 17:33:14.820489 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Instance 435314f8-f9b7-4e9c-94f3-8a84190965b9 could not be found. May 28 17:33:14.820489 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'id': '435314f8-f9b7-4e9c-94f3-8a84190965b9'} May 28 17:33:14.821430 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:33:14.821430 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:33:14.821430 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:33:14.821430 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:33:14.821430 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:33:14.821430 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:33:14.821430 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:33:14.821430 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:33:14.821430 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:33:14.821430 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:33:14.821430 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 435314f8-f9b7-4e9c-94f3-8a84190965b9 could not be found. May 28 17:33:14.821430 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:33:14.821430 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:33:14.821430 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:33:14.821430 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:33:14.821430 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:33:14.821430 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:33:14.821430 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:33:14.821430 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:33:14.821430 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:33:14.822853 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:33:14.822853 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:33:14.822853 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:33:14.822853 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:33:14.822853 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:33:14.822853 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:33:14.822853 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:33:14.822853 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 435314f8-f9b7-4e9c-94f3-8a84190965b9 could not be found. May 28 17:33:14.822853 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:33:14.822853 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:33:14.822853 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:33:14.822853 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:33:14.822853 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:33:14.822853 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:33:14.822853 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:33:14.822853 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:33:14.822853 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 435314f8-f9b7-4e9c-94f3-8a84190965b9 could not be found. May 28 17:33:14.822853 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:33:14.824604 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-cf5ae2b1-b524-4b5f-aa77-ba325d88e17e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Returning 404 to user: Instance 435314f8-f9b7-4e9c-94f3-8a84190965b9 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:33:14.824604 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-cf5ae2b1-b524-4b5f-aa77-ba325d88e17e tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9" status: 404 len: 111 microversion: 2.1 time: 0.031955 May 28 17:33:14.830431 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0e27c0fb-d081-4851-b674-a23f315bee44 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '.version_select at 0x7f9efc554040>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:14.833922 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 440/866] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:14 2022] GET /compute/v2.1/servers/435314f8-f9b7-4e9c-94f3-8a84190965b9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:33:14.848708 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0e27c0fb-d081-4851-b674-a23f315bee44 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1143580303" status: 202 len: 0 microversion: 2.1 time: 0.022565 May 28 17:33:14.849690 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 427/867] 10.222.0.33 () {58 vars in 1220 bytes} [Sat May 28 17:33:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1143580303 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 17:33:15.689804 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-aa7db451-7671-4c26-b39c-5af172eca244 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:15.690420 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-aa7db451-7671-4c26-b39c-5af172eca244 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:15.696953 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aa7db451-7671-4c26-b39c-5af172eca244 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:15.697411 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aa7db451-7671-4c26-b39c-5af172eca244 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:15.698172 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aa7db451-7671-4c26-b39c-5af172eca244 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:15.698614 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aa7db451-7671-4c26-b39c-5af172eca244 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:16.092681 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-aa7db451-7671-4c26-b39c-5af172eca244 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:16.102604 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-aa7db451-7671-4c26-b39c-5af172eca244 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2" status: 200 len: 1361 microversion: 2.1 time: 0.417271 May 28 17:33:16.103172 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 441/868] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:15 2022] GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2 => generated 1361 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:17.120040 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f19fbabf-1b2e-416b-8a71-9a2cc5494ad1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:17.120661 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f19fbabf-1b2e-416b-8a71-9a2cc5494ad1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:17.127282 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f19fbabf-1b2e-416b-8a71-9a2cc5494ad1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:17.127756 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f19fbabf-1b2e-416b-8a71-9a2cc5494ad1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:17.128526 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f19fbabf-1b2e-416b-8a71-9a2cc5494ad1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:17.128999 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f19fbabf-1b2e-416b-8a71-9a2cc5494ad1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:17.269829 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f19fbabf-1b2e-416b-8a71-9a2cc5494ad1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:17.277450 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f19fbabf-1b2e-416b-8a71-9a2cc5494ad1 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2" status: 200 len: 1361 microversion: 2.1 time: 0.161920 May 28 17:33:17.278016 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 428/869] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:17 2022] GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:17.700303 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-15bdea3d-3845-4bb2-b708-0fc330687eb3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:17.700858 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-15bdea3d-3845-4bb2-b708-0fc330687eb3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:17.708154 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-15bdea3d-3845-4bb2-b708-0fc330687eb3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:17.708608 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-15bdea3d-3845-4bb2-b708-0fc330687eb3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:17.709377 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-15bdea3d-3845-4bb2-b708-0fc330687eb3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:17.709820 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-15bdea3d-3845-4bb2-b708-0fc330687eb3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:17.728609 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:33:17.737479 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-15bdea3d-3845-4bb2-b708-0fc330687eb3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Going to try to terminate instance {{(pid=117604) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 17:33:17.814421 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-15bdea3d-3845-4bb2-b708-0fc330687eb3 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 204 len: 0 microversion: 2.1 time: 0.118127 May 28 17:33:17.815823 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 442/870] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 17:33:17 2022] DELETE /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 17:33:17.823859 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c8c73193-bbb3-4c5f-953a-9ebf26493fe6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:17.824478 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c8c73193-bbb3-4c5f-953a-9ebf26493fe6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:17.831061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c8c73193-bbb3-4c5f-953a-9ebf26493fe6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:17.831549 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c8c73193-bbb3-4c5f-953a-9ebf26493fe6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:17.832321 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c8c73193-bbb3-4c5f-953a-9ebf26493fe6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:17.832762 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c8c73193-bbb3-4c5f-953a-9ebf26493fe6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:17.847836 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:33:17.964797 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c8c73193-bbb3-4c5f-953a-9ebf26493fe6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:17.972770 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c8c73193-bbb3-4c5f-953a-9ebf26493fe6 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1507 microversion: 2.1 time: 0.152777 May 28 17:33:17.973354 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 429/871] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:17 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:18.295464 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-524b3b08-d61b-4377-9321-e2ab67264c20 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:18.296072 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-524b3b08-d61b-4377-9321-e2ab67264c20 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:18.303809 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-524b3b08-d61b-4377-9321-e2ab67264c20 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:18.304254 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-524b3b08-d61b-4377-9321-e2ab67264c20 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:18.305017 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-524b3b08-d61b-4377-9321-e2ab67264c20 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:18.305500 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-524b3b08-d61b-4377-9321-e2ab67264c20 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:18.435009 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-524b3b08-d61b-4377-9321-e2ab67264c20 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:18.442580 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-524b3b08-d61b-4377-9321-e2ab67264c20 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2" status: 200 len: 1361 microversion: 2.1 time: 0.151412 May 28 17:33:18.443152 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 443/872] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:18 2022] GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:18.990418 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-51b40e75-fae4-4986-b57a-be16b78ea6f9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:18.991152 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-51b40e75-fae4-4986-b57a-be16b78ea6f9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:18.997804 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-51b40e75-fae4-4986-b57a-be16b78ea6f9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:18.998795 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-51b40e75-fae4-4986-b57a-be16b78ea6f9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:18.999029 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-51b40e75-fae4-4986-b57a-be16b78ea6f9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:18.999496 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-51b40e75-fae4-4986-b57a-be16b78ea6f9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:19.088319 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-51b40e75-fae4-4986-b57a-be16b78ea6f9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:19.088699 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-59a5edfb-c828-4e14-b597-979f3675c5a6 req-b60b7ead-028e-4623-adb5-8e6a38b5b13a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d6203f1-8344-4493-9b94-22fb56f73a96", "name": "network-vif-deleted", "tag": "047a6d17-d6d2-4e8d-afee-99011f7fd562"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:33:19.097215 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-51b40e75-fae4-4986-b57a-be16b78ea6f9 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 200 len: 1465 microversion: 2.1 time: 0.110706 May 28 17:33:19.098066 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 430/873] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:18 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 1465 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:19.098328 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-59a5edfb-c828-4e14-b597-979f3675c5a6 req-b60b7ead-028e-4623-adb5-8e6a38b5b13a service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:19.098773 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-59a5edfb-c828-4e14-b597-979f3675c5a6 req-b60b7ead-028e-4623-adb5-8e6a38b5b13a service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:19.111309 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-59a5edfb-c828-4e14-b597-979f3675c5a6 req-b60b7ead-028e-4623-adb5-8e6a38b5b13a service nova] Creating event network-vif-deleted:047a6d17-d6d2-4e8d-afee-99011f7fd562 for instance 9d6203f1-8344-4493-9b94-22fb56f73a96 on hv-cinder-84372 May 28 17:33:19.115957 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-59a5edfb-c828-4e14-b597-979f3675c5a6 req-b60b7ead-028e-4623-adb5-8e6a38b5b13a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031133 May 28 17:33:19.116515 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 444/874] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:33:19.460108 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d6af57a0-60a9-4981-9648-d7adde7a8a73 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:19.460727 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d6af57a0-60a9-4981-9648-d7adde7a8a73 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:19.466806 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d6af57a0-60a9-4981-9648-d7adde7a8a73 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:19.467263 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d6af57a0-60a9-4981-9648-d7adde7a8a73 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:19.468063 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d6af57a0-60a9-4981-9648-d7adde7a8a73 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:19.468577 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d6af57a0-60a9-4981-9648-d7adde7a8a73 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:19.611312 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d6af57a0-60a9-4981-9648-d7adde7a8a73 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:19.620042 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d6af57a0-60a9-4981-9648-d7adde7a8a73 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2" status: 200 len: 1361 microversion: 2.1 time: 0.163867 May 28 17:33:19.620842 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 431/875] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:19 2022] GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:20.112605 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:33:20.117228 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e2bb7932-4020-4620-a8fb-19ecb0ba1d6d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:20.117925 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e2bb7932-4020-4620-a8fb-19ecb0ba1d6d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 9d6203f1-8344-4493-9b94-22fb56f73a96] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:20.124384 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e2bb7932-4020-4620-a8fb-19ecb0ba1d6d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:20.125478 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e2bb7932-4020-4620-a8fb-19ecb0ba1d6d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:20.126613 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e2bb7932-4020-4620-a8fb-19ecb0ba1d6d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:20.127052 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e2bb7932-4020-4620-a8fb-19ecb0ba1d6d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:20.142976 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-e2bb7932-4020-4620-a8fb-19ecb0ba1d6d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] HTTP exception thrown: Instance 9d6203f1-8344-4493-9b94-22fb56f73a96 could not be found. May 28 17:33:20.144865 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e2bb7932-4020-4620-a8fb-19ecb0ba1d6d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Request method failure captured: May 28 17:33:20.144865 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 HTTP/1.1 May 28 17:33:20.144865 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:33:20.144865 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:33:20.144865 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:33:20.144865 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 0 May 28 17:33:20.144865 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:33:20.144865 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:33:20.144865 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:33:20.144865 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:33:20.144865 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABiklsVPAofKmWg7pU3upj-M8izgby3MaGFgVfx3qysxJVQ7MR6rPa0rRZjJHfi41WGdE8TyYIJQQX0sUjsJLH8BfsxgRgGUV9qPuOrFObQ92QtyvsoGrvxn8VvrbGoJALWgEDz40ZCH_F7fvXkHWOXkwKXZd7Bop_F5hWOJ0OEwQXIUYI May 28 17:33:20.144865 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:33:20.144865 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:33:20.144865 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:33:20.144865 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:33:20.144865 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:33:20.144865 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:33:20.144865 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: 8e92a5dc387f47c99ce98da4d6fd9d92 May 28 17:33:20.144865 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1728494172 May 28 17:33:20.144865 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:33:20.144865 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:33:20.146446 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8e92a5dc387f47c99ce98da4d6fd9d92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8e92a5dc387f47c99ce98da4d6fd9d92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8e92a5dc387f47c99ce98da4d6fd9d92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8e92a5dc387f47c99ce98da4d6fd9d92", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:33:20.146446 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1728494172 May 28 17:33:20.146446 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 8e92a5dc387f47c99ce98da4d6fd9d92 May 28 17:33:20.146446 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1728494172 May 28 17:33:20.146446 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-ServerRescueNegativeTestJSON-1728494172-project May 28 17:33:20.146446 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:33:20.146446 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:33:20.146446 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: 927f21ef1ca74ec58f85181728933e82 May 28 17:33:20.146446 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1728494172-project May 28 17:33:20.146446 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: > May 28 17:33:20.146446 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Instance 9d6203f1-8344-4493-9b94-22fb56f73a96 could not be found. May 28 17:33:20.146446 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'id': '9d6203f1-8344-4493-9b94-22fb56f73a96'} May 28 17:33:20.147794 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:33:20.147794 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:33:20.147794 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:33:20.147794 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:33:20.147794 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:33:20.147794 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:33:20.147794 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:33:20.147794 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:33:20.147794 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:33:20.147794 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:33:20.147794 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d6203f1-8344-4493-9b94-22fb56f73a96 could not be found. May 28 17:33:20.147794 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:33:20.147794 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:33:20.147794 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:33:20.147794 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:33:20.147794 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:33:20.147794 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:33:20.147794 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:33:20.147794 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:33:20.147794 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:33:20.149216 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:33:20.149216 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:33:20.149216 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:33:20.149216 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:33:20.149216 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:33:20.149216 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:33:20.149216 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:33:20.149216 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d6203f1-8344-4493-9b94-22fb56f73a96 could not be found. May 28 17:33:20.149216 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:33:20.149216 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:33:20.149216 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:33:20.149216 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:33:20.149216 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:33:20.149216 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:33:20.149216 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:33:20.149216 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:33:20.149216 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d6203f1-8344-4493-9b94-22fb56f73a96 could not be found. May 28 17:33:20.149216 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:33:20.150788 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e2bb7932-4020-4620-a8fb-19ecb0ba1d6d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Returning 404 to user: Instance 9d6203f1-8344-4493-9b94-22fb56f73a96 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:33:20.150788 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e2bb7932-4020-4620-a8fb-19ecb0ba1d6d tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96" status: 404 len: 111 microversion: 2.1 time: 0.034615 May 28 17:33:20.150788 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 445/876] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:20 2022] GET /compute/v2.1/servers/9d6203f1-8344-4493-9b94-22fb56f73a96 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:33:20.155052 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6365ff57-8c6a-4f16-8d7f-60ce89c1c364 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:20.155790 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6365ff57-8c6a-4f16-8d7f-60ce89c1c364 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:20.157807 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=2 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:33:20.158537 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=10 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:33:20.165930 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6365ff57-8c6a-4f16-8d7f-60ce89c1c364 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:20.166381 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6365ff57-8c6a-4f16-8d7f-60ce89c1c364 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:20.167151 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6365ff57-8c6a-4f16-8d7f-60ce89c1c364 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:20.167641 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6365ff57-8c6a-4f16-8d7f-60ce89c1c364 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:20.194418 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6365ff57-8c6a-4f16-8d7f-60ce89c1c364 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Going to try to terminate instance {{(pid=117605) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 17:33:20.195104 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-a62cc380-42e6-4f4b-b671-c244e4f96f0a req-98efc13a-8560-4673-8546-f333a82d3ddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ab8f789-f8ff-4804-bfcb-3e1d600943b2", "name": "network-vif-plugged", "status": "completed", "tag": "ec8a6a71-b7c9-479a-9c50-6bdafed86a1d"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:33:20.204539 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-a62cc380-42e6-4f4b-b671-c244e4f96f0a req-98efc13a-8560-4673-8546-f333a82d3ddd service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:20.205249 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-a62cc380-42e6-4f4b-b671-c244e4f96f0a req-98efc13a-8560-4673-8546-f333a82d3ddd service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:20.217631 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-a62cc380-42e6-4f4b-b671-c244e4f96f0a req-98efc13a-8560-4673-8546-f333a82d3ddd service nova] Creating event network-vif-plugged:ec8a6a71-b7c9-479a-9c50-6bdafed86a1d for instance 4ab8f789-f8ff-4804-bfcb-3e1d600943b2 on hv-cinder-84372 May 28 17:33:20.222854 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-a62cc380-42e6-4f4b-b671-c244e4f96f0a req-98efc13a-8560-4673-8546-f333a82d3ddd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031906 May 28 17:33:20.223605 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 446/877] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:33:20.280055 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6365ff57-8c6a-4f16-8d7f-60ce89c1c364 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 204 len: 0 microversion: 2.1 time: 0.128452 May 28 17:33:20.280676 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 432/878] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 17:33:20 2022] DELETE /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 17:33:20.289445 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-64315086-c08f-4f0d-828f-1feb63114907 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:20.290304 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-64315086-c08f-4f0d-828f-1feb63114907 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:20.298878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-64315086-c08f-4f0d-828f-1feb63114907 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:20.299328 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-64315086-c08f-4f0d-828f-1feb63114907 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:20.300123 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-64315086-c08f-4f0d-828f-1feb63114907 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:20.300556 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-64315086-c08f-4f0d-828f-1feb63114907 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:20.443479 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-64315086-c08f-4f0d-828f-1feb63114907 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:20.450891 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-64315086-c08f-4f0d-828f-1feb63114907 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.165651 May 28 17:33:20.451484 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 447/879] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:20 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:20.637953 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2df9f13d-ac3b-4b14-a143-c6c8216b09cc tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:20.638561 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2df9f13d-ac3b-4b14-a143-c6c8216b09cc tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:20.644566 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2df9f13d-ac3b-4b14-a143-c6c8216b09cc tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:20.645011 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2df9f13d-ac3b-4b14-a143-c6c8216b09cc tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:20.645780 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2df9f13d-ac3b-4b14-a143-c6c8216b09cc tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:20.646230 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2df9f13d-ac3b-4b14-a143-c6c8216b09cc tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:20.778360 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2df9f13d-ac3b-4b14-a143-c6c8216b09cc tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:20.786404 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2df9f13d-ac3b-4b14-a143-c6c8216b09cc tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2" status: 200 len: 1361 microversion: 2.1 time: 0.152744 May 28 17:33:20.786969 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 433/880] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:20 2022] GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:21.468229 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-7bc06587-60c5-48c5-b6cb-db74c30cde80 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:21.469045 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-7bc06587-60c5-48c5-b6cb-db74c30cde80 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:21.475549 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7bc06587-60c5-48c5-b6cb-db74c30cde80 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:21.475997 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7bc06587-60c5-48c5-b6cb-db74c30cde80 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:21.476777 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7bc06587-60c5-48c5-b6cb-db74c30cde80 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:21.477207 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7bc06587-60c5-48c5-b6cb-db74c30cde80 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:21.605479 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7bc06587-60c5-48c5-b6cb-db74c30cde80 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:21.613439 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-7bc06587-60c5-48c5-b6cb-db74c30cde80 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.149131 May 28 17:33:21.614001 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 448/881] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:21 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:21.802932 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c02a01f8-d9f0-4b6a-998f-a6e57fd0d0c6 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:21.803588 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c02a01f8-d9f0-4b6a-998f-a6e57fd0d0c6 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:21.810022 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c02a01f8-d9f0-4b6a-998f-a6e57fd0d0c6 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:21.810475 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c02a01f8-d9f0-4b6a-998f-a6e57fd0d0c6 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:21.811234 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c02a01f8-d9f0-4b6a-998f-a6e57fd0d0c6 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:21.811704 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c02a01f8-d9f0-4b6a-998f-a6e57fd0d0c6 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:21.939673 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c02a01f8-d9f0-4b6a-998f-a6e57fd0d0c6 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:21.946965 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c02a01f8-d9f0-4b6a-998f-a6e57fd0d0c6 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2" status: 200 len: 1361 microversion: 2.1 time: 0.147913 May 28 17:33:21.947680 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 434/882] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:21 2022] GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2 => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:33:22.629965 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-12de5be1-aa31-4493-8e89-f0e0905b9cf8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:22.630837 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-12de5be1-aa31-4493-8e89-f0e0905b9cf8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:22.637458 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-12de5be1-aa31-4493-8e89-f0e0905b9cf8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:22.637908 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-12de5be1-aa31-4493-8e89-f0e0905b9cf8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:22.638667 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-12de5be1-aa31-4493-8e89-f0e0905b9cf8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:22.639103 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-12de5be1-aa31-4493-8e89-f0e0905b9cf8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:22.765577 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-12de5be1-aa31-4493-8e89-f0e0905b9cf8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:22.774509 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-12de5be1-aa31-4493-8e89-f0e0905b9cf8 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1521 microversion: 2.1 time: 0.148152 May 28 17:33:22.775081 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 449/883] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:22 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:22.963918 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ddca1a2a-698c-4afc-9946-e391b520b290 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:22.964555 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ddca1a2a-698c-4afc-9946-e391b520b290 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:22.971876 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ddca1a2a-698c-4afc-9946-e391b520b290 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:22.972332 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ddca1a2a-698c-4afc-9946-e391b520b290 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:22.973090 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ddca1a2a-698c-4afc-9946-e391b520b290 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:22.973548 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ddca1a2a-698c-4afc-9946-e391b520b290 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:23.417777 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ddca1a2a-698c-4afc-9946-e391b520b290 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:23.425955 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ddca1a2a-698c-4afc-9946-e391b520b290 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2" status: 200 len: 1361 microversion: 2.1 time: 0.465893 May 28 17:33:23.426837 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 435/884] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:22 2022] GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2 => generated 1361 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:23.573940 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-25a46fe8-5aac-44fa-82ac-456d3f2de28d req-6e8e2b8f-014b-4f99-bb5c-6d6e3d2432d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3b0710-2e45-41e0-b02a-a9b95245f62a", "name": "network-vif-deleted", "tag": "4e39dc15-aca5-489f-886d-23cd2b05b64d"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:33:23.581918 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-25a46fe8-5aac-44fa-82ac-456d3f2de28d req-6e8e2b8f-014b-4f99-bb5c-6d6e3d2432d2 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:23.582363 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-25a46fe8-5aac-44fa-82ac-456d3f2de28d req-6e8e2b8f-014b-4f99-bb5c-6d6e3d2432d2 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:23.592911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-25a46fe8-5aac-44fa-82ac-456d3f2de28d req-6e8e2b8f-014b-4f99-bb5c-6d6e3d2432d2 service nova] Creating event network-vif-deleted:4e39dc15-aca5-489f-886d-23cd2b05b64d for instance 1c3b0710-2e45-41e0-b02a-a9b95245f62a on hv-cinder-84372 May 28 17:33:23.597661 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-25a46fe8-5aac-44fa-82ac-456d3f2de28d req-6e8e2b8f-014b-4f99-bb5c-6d6e3d2432d2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027488 May 28 17:33:23.598215 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 450/885] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:33:23.794436 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ab4bfbcd-cc0c-41f3-b72f-3ebaeae43691 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:23.794969 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ab4bfbcd-cc0c-41f3-b72f-3ebaeae43691 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:23.801745 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ab4bfbcd-cc0c-41f3-b72f-3ebaeae43691 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:23.802249 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ab4bfbcd-cc0c-41f3-b72f-3ebaeae43691 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:23.803013 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ab4bfbcd-cc0c-41f3-b72f-3ebaeae43691 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:23.803476 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ab4bfbcd-cc0c-41f3-b72f-3ebaeae43691 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:23.836351 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ab4bfbcd-cc0c-41f3-b72f-3ebaeae43691 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:23.836802 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ab4bfbcd-cc0c-41f3-b72f-3ebaeae43691 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:23.837251 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-ab4bfbcd-cc0c-41f3-b72f-3ebaeae43691 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lazy-loading 'fault' on Instance uuid 1c3b0710-2e45-41e0-b02a-a9b95245f62a {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 17:33:23.883731 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ab4bfbcd-cc0c-41f3-b72f-3ebaeae43691 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927f21ef1ca74ec58f85181728933e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e92a5dc387f47c99ce98da4d6fd9d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:23.891537 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ab4bfbcd-cc0c-41f3-b72f-3ebaeae43691 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 200 len: 1312 microversion: 2.1 time: 0.101023 May 28 17:33:23.892176 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 436/886] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:23 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:24.442995 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4579a5a1-f5c7-41f0-83d6-967d376d20b2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:24.443707 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-4579a5a1-f5c7-41f0-83d6-967d376d20b2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:24.449959 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4579a5a1-f5c7-41f0-83d6-967d376d20b2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:24.450425 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4579a5a1-f5c7-41f0-83d6-967d376d20b2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:24.451177 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4579a5a1-f5c7-41f0-83d6-967d376d20b2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:24.451633 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4579a5a1-f5c7-41f0-83d6-967d376d20b2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:24.583029 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-4579a5a1-f5c7-41f0-83d6-967d376d20b2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:24.590449 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-4579a5a1-f5c7-41f0-83d6-967d376d20b2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2" status: 200 len: 1547 microversion: 2.1 time: 0.152161 May 28 17:33:24.591017 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 451/887] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:24 2022] GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:24.606266 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8195e034-474d-495a-8a3f-a928e7f35fa7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:24.606760 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8195e034-474d-495a-8a3f-a928e7f35fa7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:24.613204 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8195e034-474d-495a-8a3f-a928e7f35fa7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:24.613662 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8195e034-474d-495a-8a3f-a928e7f35fa7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:24.614428 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8195e034-474d-495a-8a3f-a928e7f35fa7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:24.614867 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8195e034-474d-495a-8a3f-a928e7f35fa7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:24.697366 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8195e034-474d-495a-8a3f-a928e7f35fa7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094856 May 28 17:33:24.698023 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 437/888] 10.222.0.33 () {58 vars in 1274 bytes} [Sat May 28 17:33:24 2022] GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:33:24.909993 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-98d43f20-58fa-492d-9011-0b0d01937c41 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:24.910654 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-98d43f20-58fa-492d-9011-0b0d01937c41 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] [instance: 1c3b0710-2e45-41e0-b02a-a9b95245f62a] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:24.917160 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-98d43f20-58fa-492d-9011-0b0d01937c41 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:24.917676 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-98d43f20-58fa-492d-9011-0b0d01937c41 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:24.918535 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-98d43f20-58fa-492d-9011-0b0d01937c41 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:24.919045 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-98d43f20-58fa-492d-9011-0b0d01937c41 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:24.932667 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-98d43f20-58fa-492d-9011-0b0d01937c41 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] HTTP exception thrown: Instance 1c3b0710-2e45-41e0-b02a-a9b95245f62a could not be found. May 28 17:33:24.934342 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-98d43f20-58fa-492d-9011-0b0d01937c41 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Request method failure captured: May 28 17:33:24.934342 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a HTTP/1.1 May 28 17:33:24.934342 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:33:24.934342 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:33:24.934342 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:33:24.934342 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 0 May 28 17:33:24.934342 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:33:24.934342 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:33:24.934342 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:33:24.934342 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:33:24.934342 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABiklsVPAofKmWg7pU3upj-M8izgby3MaGFgVfx3qysxJVQ7MR6rPa0rRZjJHfi41WGdE8TyYIJQQX0sUjsJLH8BfsxgRgGUV9qPuOrFObQ92QtyvsoGrvxn8VvrbGoJALWgEDz40ZCH_F7fvXkHWOXkwKXZd7Bop_F5hWOJ0OEwQXIUYI May 28 17:33:24.934342 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:33:24.934342 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:33:24.934342 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:33:24.934342 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:33:24.934342 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:33:24.934342 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:33:24.934342 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: 8e92a5dc387f47c99ce98da4d6fd9d92 May 28 17:33:24.934342 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1728494172 May 28 17:33:24.934342 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:33:24.934342 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:33:24.935961 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8e92a5dc387f47c99ce98da4d6fd9d92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8e92a5dc387f47c99ce98da4d6fd9d92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8e92a5dc387f47c99ce98da4d6fd9d92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8e92a5dc387f47c99ce98da4d6fd9d92", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:33:24.935961 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1728494172 May 28 17:33:24.935961 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 8e92a5dc387f47c99ce98da4d6fd9d92 May 28 17:33:24.935961 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1728494172 May 28 17:33:24.935961 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-ServerRescueNegativeTestJSON-1728494172-project May 28 17:33:24.935961 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:33:24.935961 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:33:24.935961 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: 927f21ef1ca74ec58f85181728933e82 May 28 17:33:24.935961 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1728494172-project May 28 17:33:24.935961 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: > May 28 17:33:24.935961 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Instance 1c3b0710-2e45-41e0-b02a-a9b95245f62a could not be found. May 28 17:33:24.935961 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'id': '1c3b0710-2e45-41e0-b02a-a9b95245f62a'} May 28 17:33:24.936837 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:33:24.936837 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:33:24.936837 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:33:24.936837 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:33:24.936837 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:33:24.936837 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:33:24.936837 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:33:24.936837 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:33:24.936837 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:33:24.936837 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:33:24.936837 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c3b0710-2e45-41e0-b02a-a9b95245f62a could not be found. May 28 17:33:24.936837 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:33:24.936837 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:33:24.936837 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:33:24.936837 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:33:24.936837 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:33:24.936837 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:33:24.936837 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:33:24.936837 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:33:24.936837 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:33:24.938516 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:33:24.938516 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:33:24.938516 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:33:24.938516 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:33:24.938516 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:33:24.938516 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:33:24.938516 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:33:24.938516 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c3b0710-2e45-41e0-b02a-a9b95245f62a could not be found. May 28 17:33:24.938516 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:33:24.938516 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:33:24.938516 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:33:24.938516 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:33:24.938516 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:33:24.938516 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:33:24.938516 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:33:24.938516 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:33:24.938516 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c3b0710-2e45-41e0-b02a-a9b95245f62a could not be found. May 28 17:33:24.938516 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:33:24.940124 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-98d43f20-58fa-492d-9011-0b0d01937c41 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] Returning 404 to user: Instance 1c3b0710-2e45-41e0-b02a-a9b95245f62a could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:33:24.940124 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-98d43f20-58fa-492d-9011-0b0d01937c41 tempest-ServerRescueNegativeTestJSON-1728494172 tempest-ServerRescueNegativeTestJSON-1728494172-project] 10.222.0.33 "GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a" status: 404 len: 111 microversion: 2.1 time: 0.030657 May 28 17:33:24.940124 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 452/889] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:24 2022] GET /compute/v2.1/servers/1c3b0710-2e45-41e0-b02a-a9b95245f62a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:33:26.046801 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-939bd183-a14c-40e7-b31a-173e795629de req-52b7ec10-25fd-477d-b643-4156bdf2f49d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ab8f789-f8ff-4804-bfcb-3e1d600943b2", "tag": "ec8a6a71-b7c9-479a-9c50-6bdafed86a1d"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:33:26.051095 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:33:26.057161 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-939bd183-a14c-40e7-b31a-173e795629de req-52b7ec10-25fd-477d-b643-4156bdf2f49d service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:26.057607 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-939bd183-a14c-40e7-b31a-173e795629de req-52b7ec10-25fd-477d-b643-4156bdf2f49d service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:26.070437 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-939bd183-a14c-40e7-b31a-173e795629de req-52b7ec10-25fd-477d-b643-4156bdf2f49d service nova] Creating event network-changed:ec8a6a71-b7c9-479a-9c50-6bdafed86a1d for instance 4ab8f789-f8ff-4804-bfcb-3e1d600943b2 on hv-cinder-84372 May 28 17:33:26.075438 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-939bd183-a14c-40e7-b31a-173e795629de req-52b7ec10-25fd-477d-b643-4156bdf2f49d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032644 May 28 17:33:26.076162 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 438/890] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:33:34.160321 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-68caa841-7a3c-4806-b8a1-5af3259cb102 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Action: 'create', calling method: .version_select at 0x7f9eeff4ba60>, body: {"keypair": {"name": "tempest-keypair-84358712", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjS24ukoekPvKwtgrEt1NrLA7NkDBvqQI3d0L+GAAejOoIauxbcT8Y4aS72t1qWsE/mYLOuCZVfHCoBG6Sy27QK9ooF2zSLGQuFYpYXqf+3EWaYDcIZ3mimEijGm2+4DA=="}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:33:34.166182 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:33:34.180670 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-68caa841-7a3c-4806-b8a1-5af3259cb102 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Getting quotas for project 9525b35792a04dc3a6f109cb39ee9d50. Resources: {'key_pairs'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:33:34.184474 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-68caa841-7a3c-4806-b8a1-5af3259cb102 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Getting quotas for user 7343386004e24474bc0af9126f47182b and project 9525b35792a04dc3a6f109cb39ee9d50. Resources: {'key_pairs'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:33:34.208019 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-68caa841-7a3c-4806-b8a1-5af3259cb102 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.170656 May 28 17:33:34.208626 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 453/891] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 17:33:34 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:33:35.557776 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-dc50637b-a7be-4fa7-a7f6-def5045460ee tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-309312771", "imageRef": "b2aab55c-a793-472a-bc32-81af689ad609", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f73c6d30-f59b-4e03-9c62-138278150c67"}], "security_groups": [{"name": "tempest-securitygroup--2030583811"}], "key_name": "tempest-keypair-84358712", "user_data": "}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:33:35.662118 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.network.neutron [None req-dc50637b-a7be-4fa7-a7f6-def5045460ee tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] validate_networks() for [('f73c6d30-f59b-4e03-9c62-138278150c67', None, None, None, None, None)] {{(pid=117605) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 17:33:36.034416 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-dc50637b-a7be-4fa7-a7f6-def5045460ee tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Flavor limits 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 17:33:36.034853 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-dc50637b-a7be-4fa7-a7f6-def5045460ee tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Image limits 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 17:33:36.035371 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-dc50637b-a7be-4fa7-a7f6-def5045460ee tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Flavor pref 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 17:33:36.035781 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-dc50637b-a7be-4fa7-a7f6-def5045460ee tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Image pref 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 17:33:36.036192 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-dc50637b-a7be-4fa7-a7f6-def5045460ee tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 17:33:36.044935 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dc50637b-a7be-4fa7-a7f6-def5045460ee tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:36.045384 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dc50637b-a7be-4fa7-a7f6-def5045460ee tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:36.046176 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dc50637b-a7be-4fa7-a7f6-def5045460ee tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:36.046679 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dc50637b-a7be-4fa7-a7f6-def5045460ee tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:36.063948 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-dc50637b-a7be-4fa7-a7f6-def5045460ee tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Getting quotas for project 9525b35792a04dc3a6f109cb39ee9d50. Resources: {'instances', 'cores', 'ram'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:33:36.068641 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-dc50637b-a7be-4fa7-a7f6-def5045460ee tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Getting quotas for user 7343386004e24474bc0af9126f47182b and project 9525b35792a04dc3a6f109cb39ee9d50. Resources: {'instances', 'cores', 'ram'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:33:36.079384 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-dc50637b-a7be-4fa7-a7f6-def5045460ee tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Going to run 1 instances... {{(pid=117605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 17:33:36.081905 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-dc50637b-a7be-4fa7-a7f6-def5045460ee tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 6863e51f-850f-4d83-a5ea-34408f176184] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b2aab55c-a793-472a-bc32-81af689ad609',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 17:33:36.129576 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-dc50637b-a7be-4fa7-a7f6-def5045460ee tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.577350 May 28 17:33:36.130416 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 439/892] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 17:33:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 17:33:36.140823 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f7e0a4db-843f-4d08-a7b3-25c3aa3d7c82 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:36.141891 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f7e0a4db-843f-4d08-a7b3-25c3aa3d7c82 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 6863e51f-850f-4d83-a5ea-34408f176184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:36.144233 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:33:36.212767 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f7e0a4db-843f-4d08-a7b3-25c3aa3d7c82 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:36.220247 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f7e0a4db-843f-4d08-a7b3-25c3aa3d7c82 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184" status: 200 len: 1239 microversion: 2.1 time: 0.083740 May 28 17:33:36.221158 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 454/893] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:36 2022] GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184 => generated 1239 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:37.236546 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-02168ff6-3491-40dc-a152-a268a397ebb8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:37.237163 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-02168ff6-3491-40dc-a152-a268a397ebb8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 6863e51f-850f-4d83-a5ea-34408f176184] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:37.244043 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-02168ff6-3491-40dc-a152-a268a397ebb8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:37.244500 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-02168ff6-3491-40dc-a152-a268a397ebb8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:37.245263 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-02168ff6-3491-40dc-a152-a268a397ebb8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:37.245723 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-02168ff6-3491-40dc-a152-a268a397ebb8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:37.323126 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-02168ff6-3491-40dc-a152-a268a397ebb8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:37.331646 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-02168ff6-3491-40dc-a152-a268a397ebb8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184" status: 200 len: 1235 microversion: 2.1 time: 0.099195 May 28 17:33:37.342120 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 440/894] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:37 2022] GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184 => generated 1235 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:38.350225 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3c5fc033-0004-4954-8fd3-965048cb55c8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:38.350930 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3c5fc033-0004-4954-8fd3-965048cb55c8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 6863e51f-850f-4d83-a5ea-34408f176184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:38.357788 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3c5fc033-0004-4954-8fd3-965048cb55c8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:38.358282 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3c5fc033-0004-4954-8fd3-965048cb55c8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:38.359164 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3c5fc033-0004-4954-8fd3-965048cb55c8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:38.359631 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3c5fc033-0004-4954-8fd3-965048cb55c8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:38.422007 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-3c5fc033-0004-4954-8fd3-965048cb55c8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:38.430236 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3c5fc033-0004-4954-8fd3-965048cb55c8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184" status: 200 len: 1297 microversion: 2.1 time: 0.084710 May 28 17:33:38.430800 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 455/895] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:38 2022] GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184 => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:39.448773 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-fb1dcd3d-388d-4963-9635-1d7772414ade tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:39.448773 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-fb1dcd3d-388d-4963-9635-1d7772414ade tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 6863e51f-850f-4d83-a5ea-34408f176184] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:39.454960 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fb1dcd3d-388d-4963-9635-1d7772414ade tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:39.455963 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fb1dcd3d-388d-4963-9635-1d7772414ade tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:39.456731 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fb1dcd3d-388d-4963-9635-1d7772414ade tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:39.457159 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fb1dcd3d-388d-4963-9635-1d7772414ade tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:39.662970 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-03e20951-a797-4b4c-baa3-5b19ad444c19 req-d73830df-cb36-4223-9cb6-dc9015f6f21b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6863e51f-850f-4d83-a5ea-34408f176184", "tag": "f9b3d611-66b6-43d5-b2bc-e8228c900bb3"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:33:39.672685 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-03e20951-a797-4b4c-baa3-5b19ad444c19 req-d73830df-cb36-4223-9cb6-dc9015f6f21b service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:39.673266 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-03e20951-a797-4b4c-baa3-5b19ad444c19 req-d73830df-cb36-4223-9cb6-dc9015f6f21b service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:39.687425 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-03e20951-a797-4b4c-baa3-5b19ad444c19 req-d73830df-cb36-4223-9cb6-dc9015f6f21b service nova] Creating event network-changed:f9b3d611-66b6-43d5-b2bc-e8228c900bb3 for instance 6863e51f-850f-4d83-a5ea-34408f176184 on hv-cinder-84372 May 28 17:33:39.689833 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-fb1dcd3d-388d-4963-9635-1d7772414ade tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:39.694017 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-03e20951-a797-4b4c-baa3-5b19ad444c19 req-d73830df-cb36-4223-9cb6-dc9015f6f21b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035475 May 28 17:33:39.694628 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 456/896] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:33:39.699992 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-fb1dcd3d-388d-4963-9635-1d7772414ade tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184" status: 200 len: 1365 microversion: 2.1 time: 0.255546 May 28 17:33:39.709049 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 441/897] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:39 2022] GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184 => generated 1365 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:40.726082 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-cdeb0c0e-7176-4e02-9f2a-28364c412d1f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:40.726786 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-cdeb0c0e-7176-4e02-9f2a-28364c412d1f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 6863e51f-850f-4d83-a5ea-34408f176184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:40.733092 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cdeb0c0e-7176-4e02-9f2a-28364c412d1f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:40.733541 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cdeb0c0e-7176-4e02-9f2a-28364c412d1f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:40.734298 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cdeb0c0e-7176-4e02-9f2a-28364c412d1f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:40.734737 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cdeb0c0e-7176-4e02-9f2a-28364c412d1f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:40.861226 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-cdeb0c0e-7176-4e02-9f2a-28364c412d1f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:40.869167 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-cdeb0c0e-7176-4e02-9f2a-28364c412d1f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184" status: 200 len: 1365 microversion: 2.1 time: 0.147859 May 28 17:33:40.869724 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 457/898] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:40 2022] GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:41.886701 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7d562d8a-1c29-47a1-9da7-2a062ebf0a78 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:41.887367 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7d562d8a-1c29-47a1-9da7-2a062ebf0a78 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 6863e51f-850f-4d83-a5ea-34408f176184] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:41.893982 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7d562d8a-1c29-47a1-9da7-2a062ebf0a78 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:41.894437 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7d562d8a-1c29-47a1-9da7-2a062ebf0a78 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:41.895206 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7d562d8a-1c29-47a1-9da7-2a062ebf0a78 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:41.895698 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7d562d8a-1c29-47a1-9da7-2a062ebf0a78 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:42.033722 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7d562d8a-1c29-47a1-9da7-2a062ebf0a78 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:42.041274 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7d562d8a-1c29-47a1-9da7-2a062ebf0a78 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184" status: 200 len: 1365 microversion: 2.1 time: 0.158450 May 28 17:33:42.041835 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 442/899] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:41 2022] GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:43.058555 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a7b9644c-37bb-4b66-94c7-310ccc52f1f8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:43.059091 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a7b9644c-37bb-4b66-94c7-310ccc52f1f8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 6863e51f-850f-4d83-a5ea-34408f176184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:43.066852 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a7b9644c-37bb-4b66-94c7-310ccc52f1f8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:43.067297 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a7b9644c-37bb-4b66-94c7-310ccc52f1f8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:43.068225 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a7b9644c-37bb-4b66-94c7-310ccc52f1f8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:43.068637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a7b9644c-37bb-4b66-94c7-310ccc52f1f8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:43.197655 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a7b9644c-37bb-4b66-94c7-310ccc52f1f8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:43.205126 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a7b9644c-37bb-4b66-94c7-310ccc52f1f8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184" status: 200 len: 1365 microversion: 2.1 time: 0.150531 May 28 17:33:43.205684 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 458/900] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:43 2022] GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:44.221977 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1d7430f7-964b-4eca-8526-e29754098099 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:44.222600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1d7430f7-964b-4eca-8526-e29754098099 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 6863e51f-850f-4d83-a5ea-34408f176184] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:44.229079 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1d7430f7-964b-4eca-8526-e29754098099 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:44.229533 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1d7430f7-964b-4eca-8526-e29754098099 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:44.230298 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1d7430f7-964b-4eca-8526-e29754098099 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:44.230742 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1d7430f7-964b-4eca-8526-e29754098099 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:44.321962 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-6987f32b-3c3b-4733-a901-28f236433a35 req-02a2cc9b-7773-4d61-bf98-34ac0fa6deb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6863e51f-850f-4d83-a5ea-34408f176184", "name": "network-vif-plugged", "status": "completed", "tag": "f9b3d611-66b6-43d5-b2bc-e8228c900bb3"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:33:44.333679 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-6987f32b-3c3b-4733-a901-28f236433a35 req-02a2cc9b-7773-4d61-bf98-34ac0fa6deb6 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:44.334141 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-6987f32b-3c3b-4733-a901-28f236433a35 req-02a2cc9b-7773-4d61-bf98-34ac0fa6deb6 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:44.345833 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-6987f32b-3c3b-4733-a901-28f236433a35 req-02a2cc9b-7773-4d61-bf98-34ac0fa6deb6 service nova] Creating event network-vif-plugged:f9b3d611-66b6-43d5-b2bc-e8228c900bb3 for instance 6863e51f-850f-4d83-a5ea-34408f176184 on hv-cinder-84372 May 28 17:33:44.350964 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-6987f32b-3c3b-4733-a901-28f236433a35 req-02a2cc9b-7773-4d61-bf98-34ac0fa6deb6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032972 May 28 17:33:44.351608 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 459/901] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:33:44.365396 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1d7430f7-964b-4eca-8526-e29754098099 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:44.372873 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1d7430f7-964b-4eca-8526-e29754098099 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184" status: 200 len: 1365 microversion: 2.1 time: 0.154902 May 28 17:33:44.373438 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 443/902] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:44 2022] GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:33:45.390820 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9c991e70-6606-4d41-b451-f715e9e9f9c6 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:45.391557 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-9c991e70-6606-4d41-b451-f715e9e9f9c6 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 6863e51f-850f-4d83-a5ea-34408f176184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:45.398031 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9c991e70-6606-4d41-b451-f715e9e9f9c6 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:45.398481 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9c991e70-6606-4d41-b451-f715e9e9f9c6 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:45.399241 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9c991e70-6606-4d41-b451-f715e9e9f9c6 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:45.399705 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-9c991e70-6606-4d41-b451-f715e9e9f9c6 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:45.527640 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-9c991e70-6606-4d41-b451-f715e9e9f9c6 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:45.536649 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9c991e70-6606-4d41-b451-f715e9e9f9c6 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184" status: 200 len: 1365 microversion: 2.1 time: 0.150479 May 28 17:33:45.537216 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 460/903] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:45 2022] GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:33:46.553914 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c9eb8053-133f-4f8b-ac17-a20936aba7cb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:46.554529 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c9eb8053-133f-4f8b-ac17-a20936aba7cb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 6863e51f-850f-4d83-a5ea-34408f176184] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:46.559991 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=2 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:33:46.560647 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=6 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:33:46.562845 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c9eb8053-133f-4f8b-ac17-a20936aba7cb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:46.563299 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c9eb8053-133f-4f8b-ac17-a20936aba7cb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:46.564119 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c9eb8053-133f-4f8b-ac17-a20936aba7cb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:46.565054 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c9eb8053-133f-4f8b-ac17-a20936aba7cb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:46.701960 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c9eb8053-133f-4f8b-ac17-a20936aba7cb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:33:46.710672 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c9eb8053-133f-4f8b-ac17-a20936aba7cb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184" status: 200 len: 1554 microversion: 2.1 time: 0.160854 May 28 17:33:46.711248 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 444/904] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:33:46 2022] GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:33:46.727299 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-af6e40dd-69ac-4c5e-be56-d3ebd26de897 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:33:46.727851 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-af6e40dd-69ac-4c5e-be56-d3ebd26de897 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 6863e51f-850f-4d83-a5ea-34408f176184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:33:46.729827 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=6 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:33:46.735613 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-af6e40dd-69ac-4c5e-be56-d3ebd26de897 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:46.736063 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-af6e40dd-69ac-4c5e-be56-d3ebd26de897 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:46.737551 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-af6e40dd-69ac-4c5e-be56-d3ebd26de897 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:46.737990 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-af6e40dd-69ac-4c5e-be56-d3ebd26de897 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:46.815147 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-af6e40dd-69ac-4c5e-be56-d3ebd26de897 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091008 May 28 17:33:46.815882 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 461/905] 10.222.0.33 () {58 vars in 1274 bytes} [Sat May 28 17:33:46 2022] GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:33:47.977702 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-2dcacf21-437e-4b23-92db-65c977303dd8 req-a0b80556-74e7-4a4d-b00d-df8e1393de50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6863e51f-850f-4d83-a5ea-34408f176184", "tag": "f9b3d611-66b6-43d5-b2bc-e8228c900bb3"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:33:47.985704 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-2dcacf21-437e-4b23-92db-65c977303dd8 req-a0b80556-74e7-4a4d-b00d-df8e1393de50 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:33:47.986151 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-2dcacf21-437e-4b23-92db-65c977303dd8 req-a0b80556-74e7-4a4d-b00d-df8e1393de50 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:33:47.989540 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:33:47.998957 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-2dcacf21-437e-4b23-92db-65c977303dd8 req-a0b80556-74e7-4a4d-b00d-df8e1393de50 service nova] Creating event network-changed:f9b3d611-66b6-43d5-b2bc-e8228c900bb3 for instance 6863e51f-850f-4d83-a5ea-34408f176184 on hv-cinder-84372 May 28 17:33:48.004388 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-2dcacf21-437e-4b23-92db-65c977303dd8 req-a0b80556-74e7-4a4d-b00d-df8e1393de50 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030389 May 28 17:33:48.005075 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 445/906] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:34:12.533823 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:34:12.535100 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=32 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:34:12.539244 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3acb1381-66ea-43d0-a51f-a62a879fac65 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:34:12.539803 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3acb1381-66ea-43d0-a51f-a62a879fac65 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:12.546792 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3acb1381-66ea-43d0-a51f-a62a879fac65 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:12.547239 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3acb1381-66ea-43d0-a51f-a62a879fac65 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:12.548053 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3acb1381-66ea-43d0-a51f-a62a879fac65 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:12.548484 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3acb1381-66ea-43d0-a51f-a62a879fac65 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:12.571374 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-3acb1381-66ea-43d0-a51f-a62a879fac65 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lazy-loading 'flavor' on Instance uuid 281e6309-8591-49e7-ab2a-e36aa0fad594 {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 17:34:12.643196 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3acb1381-66ea-43d0-a51f-a62a879fac65 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "POST /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594/action" status: 202 len: 0 microversion: 2.1 time: 0.110501 May 28 17:34:12.644023 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 462/907] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 17:34:12 2022] POST /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 17:34:12.650740 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:34:12.656403 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-74302cad-1091-4bb4-8560-c6f2aa9134b1 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:12.657102 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-74302cad-1091-4bb4-8560-c6f2aa9134b1 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:12.666821 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-74302cad-1091-4bb4-8560-c6f2aa9134b1 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:12.667269 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-74302cad-1091-4bb4-8560-c6f2aa9134b1 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:12.668066 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-74302cad-1091-4bb4-8560-c6f2aa9134b1 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:12.668504 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-74302cad-1091-4bb4-8560-c6f2aa9134b1 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:12.808387 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-74302cad-1091-4bb4-8560-c6f2aa9134b1 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:12.818025 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-74302cad-1091-4bb4-8560-c6f2aa9134b1 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1571 microversion: 2.1 time: 0.168916 May 28 17:34:12.818600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 446/908] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:34:12 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1571 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:34:13.838325 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d5e12ce1-3530-4b88-92ae-5ca8a1cde3da tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:13.839024 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d5e12ce1-3530-4b88-92ae-5ca8a1cde3da tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:13.845713 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d5e12ce1-3530-4b88-92ae-5ca8a1cde3da tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:13.846159 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d5e12ce1-3530-4b88-92ae-5ca8a1cde3da tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:13.846921 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d5e12ce1-3530-4b88-92ae-5ca8a1cde3da tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:13.847401 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d5e12ce1-3530-4b88-92ae-5ca8a1cde3da tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:13.982784 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d5e12ce1-3530-4b88-92ae-5ca8a1cde3da tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:13.990282 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d5e12ce1-3530-4b88-92ae-5ca8a1cde3da tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1571 microversion: 2.1 time: 0.156227 May 28 17:34:13.990843 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 463/909] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:34:13 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:34:15.006682 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f177c143-b3aa-4f5d-87a8-47c59ede9c38 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:15.007580 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f177c143-b3aa-4f5d-87a8-47c59ede9c38 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:15.013979 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f177c143-b3aa-4f5d-87a8-47c59ede9c38 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:15.014420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f177c143-b3aa-4f5d-87a8-47c59ede9c38 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:15.015202 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f177c143-b3aa-4f5d-87a8-47c59ede9c38 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:15.015673 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f177c143-b3aa-4f5d-87a8-47c59ede9c38 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:15.149259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f177c143-b3aa-4f5d-87a8-47c59ede9c38 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:15.156604 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f177c143-b3aa-4f5d-87a8-47c59ede9c38 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1571 microversion: 2.1 time: 0.153919 May 28 17:34:15.157164 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 447/910] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:34:15 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:34:16.174131 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-af2add95-4336-4363-96e0-f0eda25ba863 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:16.174668 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-af2add95-4336-4363-96e0-f0eda25ba863 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:16.181780 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-af2add95-4336-4363-96e0-f0eda25ba863 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:16.182223 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-af2add95-4336-4363-96e0-f0eda25ba863 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:16.182977 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-af2add95-4336-4363-96e0-f0eda25ba863 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:16.183437 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-af2add95-4336-4363-96e0-f0eda25ba863 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:16.310933 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-af2add95-4336-4363-96e0-f0eda25ba863 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:16.319460 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-af2add95-4336-4363-96e0-f0eda25ba863 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1571 microversion: 2.1 time: 0.149357 May 28 17:34:16.320014 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 464/911] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:34:16 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1571 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:34:17.335799 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-99d6cff4-21ea-4f7a-bf27-38068a37f183 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:17.336410 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-99d6cff4-21ea-4f7a-bf27-38068a37f183 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:17.342568 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-99d6cff4-21ea-4f7a-bf27-38068a37f183 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:17.343019 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-99d6cff4-21ea-4f7a-bf27-38068a37f183 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:17.343813 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-99d6cff4-21ea-4f7a-bf27-38068a37f183 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:17.344278 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-99d6cff4-21ea-4f7a-bf27-38068a37f183 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:17.477172 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-99d6cff4-21ea-4f7a-bf27-38068a37f183 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:17.484629 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-99d6cff4-21ea-4f7a-bf27-38068a37f183 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1571 microversion: 2.1 time: 0.152956 May 28 17:34:17.485185 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 448/912] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:34:17 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1571 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:34:18.502227 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-61e9378a-f823-4af5-95aa-5b4015f3f5c3 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:18.502840 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-61e9378a-f823-4af5-95aa-5b4015f3f5c3 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:18.510585 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-61e9378a-f823-4af5-95aa-5b4015f3f5c3 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:18.511031 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-61e9378a-f823-4af5-95aa-5b4015f3f5c3 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:18.511811 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-61e9378a-f823-4af5-95aa-5b4015f3f5c3 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:18.512242 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-61e9378a-f823-4af5-95aa-5b4015f3f5c3 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:18.644543 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-61e9378a-f823-4af5-95aa-5b4015f3f5c3 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:18.651958 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-61e9378a-f823-4af5-95aa-5b4015f3f5c3 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1571 microversion: 2.1 time: 0.153784 May 28 17:34:18.652529 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 465/913] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:34:18 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:34:19.500042 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-37cd9eff-6d0c-4191-85b7-e41156b35d75 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:19.500623 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-37cd9eff-6d0c-4191-85b7-e41156b35d75 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:19.507648 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-37cd9eff-6d0c-4191-85b7-e41156b35d75 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:19.508111 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-37cd9eff-6d0c-4191-85b7-e41156b35d75 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:19.508882 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-37cd9eff-6d0c-4191-85b7-e41156b35d75 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:19.509323 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-37cd9eff-6d0c-4191-85b7-e41156b35d75 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:19.531903 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-37cd9eff-6d0c-4191-85b7-e41156b35d75 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad/ips" status: 200 len: 152 microversion: 2.20 time: 0.035863 May 28 17:34:19.532471 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 449/914] 10.222.0.33 () {60 vars in 1288 bytes} [Sat May 28 17:34:19 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 17:34:19.668951 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-fdb8ac6e-4cde-4955-b052-11714fbb529f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:19.669655 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-fdb8ac6e-4cde-4955-b052-11714fbb529f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:19.676183 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fdb8ac6e-4cde-4955-b052-11714fbb529f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:19.676623 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fdb8ac6e-4cde-4955-b052-11714fbb529f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:19.677388 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fdb8ac6e-4cde-4955-b052-11714fbb529f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:19.677889 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fdb8ac6e-4cde-4955-b052-11714fbb529f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:19.826625 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-fdb8ac6e-4cde-4955-b052-11714fbb529f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:19.835320 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-fdb8ac6e-4cde-4955-b052-11714fbb529f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1571 microversion: 2.1 time: 0.170322 May 28 17:34:19.836121 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 466/915] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:34:19 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1571 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:34:20.852492 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-670dfa40-196a-4390-9bf7-279eb7a9ad37 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:20.853110 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-670dfa40-196a-4390-9bf7-279eb7a9ad37 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:20.859604 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-670dfa40-196a-4390-9bf7-279eb7a9ad37 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:20.860073 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-670dfa40-196a-4390-9bf7-279eb7a9ad37 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:20.860915 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-670dfa40-196a-4390-9bf7-279eb7a9ad37 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:20.861364 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-670dfa40-196a-4390-9bf7-279eb7a9ad37 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:20.993895 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-670dfa40-196a-4390-9bf7-279eb7a9ad37 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:21.001398 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-670dfa40-196a-4390-9bf7-279eb7a9ad37 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1571 microversion: 2.1 time: 0.152851 May 28 17:34:21.001961 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 450/916] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:34:20 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1571 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:34:21.338394 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a2a5f646-7656-4900-889e-e825de55b81d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:34:21.338934 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a2a5f646-7656-4900-889e-e825de55b81d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:21.344860 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a2a5f646-7656-4900-889e-e825de55b81d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:21.345308 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a2a5f646-7656-4900-889e-e825de55b81d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:21.346067 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a2a5f646-7656-4900-889e-e825de55b81d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:21.346503 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a2a5f646-7656-4900-889e-e825de55b81d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:21.372299 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-a2a5f646-7656-4900-889e-e825de55b81d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lazy-loading 'flavor' on Instance uuid 27322ac4-8704-4f1a-b431-e5c4ad7d77ad {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 17:34:21.630498 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a2a5f646-7656-4900-889e-e825de55b81d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "POST /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad/action" status: 202 len: 0 microversion: 2.20 time: 0.296164 May 28 17:34:21.631240 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 467/917] 10.222.0.33 () {62 vars in 1318 bytes} [Sat May 28 17:34:21 2022] POST /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 17:34:21.639525 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5f1e5a62-bb0b-4ca7-96ac-23853a33a772 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:21.640149 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5f1e5a62-bb0b-4ca7-96ac-23853a33a772 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:21.646894 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5f1e5a62-bb0b-4ca7-96ac-23853a33a772 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:21.647396 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5f1e5a62-bb0b-4ca7-96ac-23853a33a772 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:21.648320 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5f1e5a62-bb0b-4ca7-96ac-23853a33a772 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:21.648811 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5f1e5a62-bb0b-4ca7-96ac-23853a33a772 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:21.784892 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5f1e5a62-bb0b-4ca7-96ac-23853a33a772 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:21.792760 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5f1e5a62-bb0b-4ca7-96ac-23853a33a772 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:21.794277 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5f1e5a62-bb0b-4ca7-96ac-23853a33a772 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:21.795473 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5f1e5a62-bb0b-4ca7-96ac-23853a33a772 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1723 microversion: 2.20 time: 0.159834 May 28 17:34:21.796032 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 451/918] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:21 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:34:22.019162 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a5a178df-6016-4e8f-8026-4403088dbdef tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:22.019889 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a5a178df-6016-4e8f-8026-4403088dbdef tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:22.026224 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a5a178df-6016-4e8f-8026-4403088dbdef tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:22.026675 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a5a178df-6016-4e8f-8026-4403088dbdef tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:22.027462 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a5a178df-6016-4e8f-8026-4403088dbdef tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:22.027900 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a5a178df-6016-4e8f-8026-4403088dbdef tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:22.161076 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a5a178df-6016-4e8f-8026-4403088dbdef tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:22.168444 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a5a178df-6016-4e8f-8026-4403088dbdef tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1571 microversion: 2.1 time: 0.153651 May 28 17:34:22.168995 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 468/919] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:34:22 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:34:22.814149 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a2d1052a-a7a6-47ef-8622-0c89d217572e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:22.814758 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a2d1052a-a7a6-47ef-8622-0c89d217572e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:22.821422 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a2d1052a-a7a6-47ef-8622-0c89d217572e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:22.821869 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a2d1052a-a7a6-47ef-8622-0c89d217572e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:22.822616 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a2d1052a-a7a6-47ef-8622-0c89d217572e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:22.823049 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a2d1052a-a7a6-47ef-8622-0c89d217572e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:22.994597 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a2d1052a-a7a6-47ef-8622-0c89d217572e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:23.002863 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a2d1052a-a7a6-47ef-8622-0c89d217572e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:23.005129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a2d1052a-a7a6-47ef-8622-0c89d217572e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:23.006414 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a2d1052a-a7a6-47ef-8622-0c89d217572e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1723 microversion: 2.20 time: 0.196191 May 28 17:34:23.007469 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 452/920] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:22 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:34:23.186045 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1b58d1ae-a8ae-4f52-9977-997505b59bf4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:23.187281 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1b58d1ae-a8ae-4f52-9977-997505b59bf4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:23.194558 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1b58d1ae-a8ae-4f52-9977-997505b59bf4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:23.195005 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1b58d1ae-a8ae-4f52-9977-997505b59bf4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:23.195805 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1b58d1ae-a8ae-4f52-9977-997505b59bf4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:23.196248 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1b58d1ae-a8ae-4f52-9977-997505b59bf4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:23.331087 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1b58d1ae-a8ae-4f52-9977-997505b59bf4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:23.338714 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1b58d1ae-a8ae-4f52-9977-997505b59bf4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1571 microversion: 2.1 time: 0.156611 May 28 17:34:23.339282 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 469/921] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:34:23 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:34:24.026005 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f5541fe4-6a6c-41c2-9227-319be2b93bd6 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:24.026564 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f5541fe4-6a6c-41c2-9227-319be2b93bd6 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:24.032974 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f5541fe4-6a6c-41c2-9227-319be2b93bd6 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:24.033420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f5541fe4-6a6c-41c2-9227-319be2b93bd6 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:24.034788 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f5541fe4-6a6c-41c2-9227-319be2b93bd6 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:24.035671 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f5541fe4-6a6c-41c2-9227-319be2b93bd6 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:24.166807 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f5541fe4-6a6c-41c2-9227-319be2b93bd6 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:24.176362 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f5541fe4-6a6c-41c2-9227-319be2b93bd6 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:24.177859 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f5541fe4-6a6c-41c2-9227-319be2b93bd6 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:24.179012 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f5541fe4-6a6c-41c2-9227-319be2b93bd6 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1723 microversion: 2.20 time: 0.156947 May 28 17:34:24.179615 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 453/922] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:24 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:34:24.355963 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5f954326-174d-4807-982c-62b4a786e486 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:24.356544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5f954326-174d-4807-982c-62b4a786e486 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:24.363136 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5f954326-174d-4807-982c-62b4a786e486 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:24.363612 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5f954326-174d-4807-982c-62b4a786e486 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:24.364370 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5f954326-174d-4807-982c-62b4a786e486 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:24.364804 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5f954326-174d-4807-982c-62b4a786e486 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:24.497724 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5f954326-174d-4807-982c-62b4a786e486 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:24.506167 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5f954326-174d-4807-982c-62b4a786e486 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1571 microversion: 2.1 time: 0.154137 May 28 17:34:24.506712 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 470/923] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:34:24 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:34:25.198260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-27189ca7-44e9-4536-8693-ddc877556a1c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:25.198880 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-27189ca7-44e9-4536-8693-ddc877556a1c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:25.205699 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-27189ca7-44e9-4536-8693-ddc877556a1c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:25.206154 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-27189ca7-44e9-4536-8693-ddc877556a1c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:25.206919 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-27189ca7-44e9-4536-8693-ddc877556a1c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:25.207381 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-27189ca7-44e9-4536-8693-ddc877556a1c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:25.337199 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-27189ca7-44e9-4536-8693-ddc877556a1c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:25.345235 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-27189ca7-44e9-4536-8693-ddc877556a1c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:25.346824 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-27189ca7-44e9-4536-8693-ddc877556a1c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:25.348597 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-27189ca7-44e9-4536-8693-ddc877556a1c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1723 microversion: 2.20 time: 0.154591 May 28 17:34:25.349164 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 454/924] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:25 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:34:25.523263 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d16f5bde-ebdc-4448-85bc-0eda4e97161f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:25.523917 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d16f5bde-ebdc-4448-85bc-0eda4e97161f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:25.530060 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d16f5bde-ebdc-4448-85bc-0eda4e97161f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:25.530511 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d16f5bde-ebdc-4448-85bc-0eda4e97161f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:25.531283 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d16f5bde-ebdc-4448-85bc-0eda4e97161f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:25.531745 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d16f5bde-ebdc-4448-85bc-0eda4e97161f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:25.669078 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d16f5bde-ebdc-4448-85bc-0eda4e97161f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:25.676721 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d16f5bde-ebdc-4448-85bc-0eda4e97161f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1571 microversion: 2.1 time: 0.157140 May 28 17:34:25.677383 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 471/925] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:34:25 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:34:26.367185 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-62f833c9-e94a-42ea-8bca-e0b55b02e2c7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:26.367836 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-62f833c9-e94a-42ea-8bca-e0b55b02e2c7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:26.374267 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-62f833c9-e94a-42ea-8bca-e0b55b02e2c7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:26.374718 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-62f833c9-e94a-42ea-8bca-e0b55b02e2c7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:26.375511 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-62f833c9-e94a-42ea-8bca-e0b55b02e2c7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:26.375955 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-62f833c9-e94a-42ea-8bca-e0b55b02e2c7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:26.507701 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-62f833c9-e94a-42ea-8bca-e0b55b02e2c7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:26.515687 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-62f833c9-e94a-42ea-8bca-e0b55b02e2c7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:26.517206 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-62f833c9-e94a-42ea-8bca-e0b55b02e2c7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:26.518429 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-62f833c9-e94a-42ea-8bca-e0b55b02e2c7 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1723 microversion: 2.20 time: 0.155115 May 28 17:34:26.519382 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 455/926] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:26 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:34:26.694331 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e4ae37da-5a98-4d8f-8035-4038fcd66f2f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:26.694950 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e4ae37da-5a98-4d8f-8035-4038fcd66f2f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:26.701527 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e4ae37da-5a98-4d8f-8035-4038fcd66f2f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:26.701982 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e4ae37da-5a98-4d8f-8035-4038fcd66f2f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:26.702746 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e4ae37da-5a98-4d8f-8035-4038fcd66f2f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:26.703195 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e4ae37da-5a98-4d8f-8035-4038fcd66f2f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:26.835082 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e4ae37da-5a98-4d8f-8035-4038fcd66f2f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:26.842549 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e4ae37da-5a98-4d8f-8035-4038fcd66f2f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1512 microversion: 2.1 time: 0.152358 May 28 17:34:26.843113 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 472/927] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:34:26 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:34:26.859601 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1f2ffdc3-ffb9-43e6-b909-fbd3529b9988 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:34:26.860173 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1f2ffdc3-ffb9-43e6-b909-fbd3529b9988 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:26.866769 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1f2ffdc3-ffb9-43e6-b909-fbd3529b9988 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:26.867218 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1f2ffdc3-ffb9-43e6-b909-fbd3529b9988 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:26.868022 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1f2ffdc3-ffb9-43e6-b909-fbd3529b9988 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:26.868467 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1f2ffdc3-ffb9-43e6-b909-fbd3529b9988 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:26.942209 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1f2ffdc3-ffb9-43e6-b909-fbd3529b9988 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "POST /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594/action" status: 202 len: 0 microversion: 2.1 time: 0.086266 May 28 17:34:26.943088 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 456/928] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 17:34:26 2022] POST /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 17:34:26.950996 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0aa2d4e0-c5e5-4801-8020-7e1ecf1acb15 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:26.951667 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0aa2d4e0-c5e5-4801-8020-7e1ecf1acb15 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:26.957867 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0aa2d4e0-c5e5-4801-8020-7e1ecf1acb15 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:26.958396 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0aa2d4e0-c5e5-4801-8020-7e1ecf1acb15 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:26.959268 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0aa2d4e0-c5e5-4801-8020-7e1ecf1acb15 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:26.959751 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0aa2d4e0-c5e5-4801-8020-7e1ecf1acb15 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:27.095803 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0aa2d4e0-c5e5-4801-8020-7e1ecf1acb15 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:27.104193 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0aa2d4e0-c5e5-4801-8020-7e1ecf1acb15 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1520 microversion: 2.1 time: 0.157066 May 28 17:34:27.104764 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 473/929] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:34:26 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:34:27.539252 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8f586e53-07de-4254-aceb-c83a132b45e8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:27.539994 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8f586e53-07de-4254-aceb-c83a132b45e8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:27.547065 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8f586e53-07de-4254-aceb-c83a132b45e8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:27.547546 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8f586e53-07de-4254-aceb-c83a132b45e8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:27.548557 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8f586e53-07de-4254-aceb-c83a132b45e8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:27.549274 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8f586e53-07de-4254-aceb-c83a132b45e8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:27.686119 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8f586e53-07de-4254-aceb-c83a132b45e8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:27.694221 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8f586e53-07de-4254-aceb-c83a132b45e8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:27.695768 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8f586e53-07de-4254-aceb-c83a132b45e8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:27.696950 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8f586e53-07de-4254-aceb-c83a132b45e8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1723 microversion: 2.20 time: 0.163956 May 28 17:34:27.697506 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 457/930] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:27 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:34:28.121448 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-aa2cb42b-e970-464f-b383-5bf0f466f19f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:28.122146 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-aa2cb42b-e970-464f-b383-5bf0f466f19f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:28.128528 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aa2cb42b-e970-464f-b383-5bf0f466f19f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:28.128977 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aa2cb42b-e970-464f-b383-5bf0f466f19f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:28.129744 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aa2cb42b-e970-464f-b383-5bf0f466f19f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:28.130181 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aa2cb42b-e970-464f-b383-5bf0f466f19f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:28.149482 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:34:28.275258 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-aa2cb42b-e970-464f-b383-5bf0f466f19f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:28.282942 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-aa2cb42b-e970-464f-b383-5bf0f466f19f tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1522 microversion: 2.1 time: 0.165454 May 28 17:34:28.283586 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 474/931] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:34:28 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:34:28.490122 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-341306a2-6caa-429e-b572-53c684318452 req-697f38e3-2b61-47f2-9069-7d1b6417eeec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "281e6309-8591-49e7-ab2a-e36aa0fad594", "name": "network-vif-unplugged", "status": "completed", "tag": "50d0ffcf-e908-48f5-9b29-2b70709081b6"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:34:28.501256 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-341306a2-6caa-429e-b572-53c684318452 req-697f38e3-2b61-47f2-9069-7d1b6417eeec service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:28.502232 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-341306a2-6caa-429e-b572-53c684318452 req-697f38e3-2b61-47f2-9069-7d1b6417eeec service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:28.515837 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-341306a2-6caa-429e-b572-53c684318452 req-697f38e3-2b61-47f2-9069-7d1b6417eeec service nova] Creating event network-vif-unplugged:50d0ffcf-e908-48f5-9b29-2b70709081b6 for instance 281e6309-8591-49e7-ab2a-e36aa0fad594 on hv-cinder-84372 May 28 17:34:28.521950 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-341306a2-6caa-429e-b572-53c684318452 req-697f38e3-2b61-47f2-9069-7d1b6417eeec service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036386 May 28 17:34:28.522554 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 458/932] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:34:28.715565 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-fdeea0b5-a0d0-4ff6-961c-5263ad313575 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:28.716288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-fdeea0b5-a0d0-4ff6-961c-5263ad313575 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:28.722863 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fdeea0b5-a0d0-4ff6-961c-5263ad313575 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:28.724049 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fdeea0b5-a0d0-4ff6-961c-5263ad313575 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:28.724169 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fdeea0b5-a0d0-4ff6-961c-5263ad313575 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:28.724573 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fdeea0b5-a0d0-4ff6-961c-5263ad313575 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:28.866212 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-fdeea0b5-a0d0-4ff6-961c-5263ad313575 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:28.874408 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-fdeea0b5-a0d0-4ff6-961c-5263ad313575 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:28.875935 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-fdeea0b5-a0d0-4ff6-961c-5263ad313575 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:28.877123 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-fdeea0b5-a0d0-4ff6-961c-5263ad313575 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1723 microversion: 2.20 time: 0.165612 May 28 17:34:28.878967 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 475/933] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:28 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:34:29.302051 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ca62c96f-05d2-4bb6-97e9-5cc5737fe583 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:29.302681 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ca62c96f-05d2-4bb6-97e9-5cc5737fe583 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:29.308968 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ca62c96f-05d2-4bb6-97e9-5cc5737fe583 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:29.309427 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ca62c96f-05d2-4bb6-97e9-5cc5737fe583 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:29.310199 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ca62c96f-05d2-4bb6-97e9-5cc5737fe583 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:29.310643 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ca62c96f-05d2-4bb6-97e9-5cc5737fe583 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:29.459787 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ca62c96f-05d2-4bb6-97e9-5cc5737fe583 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:29.468953 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ca62c96f-05d2-4bb6-97e9-5cc5737fe583 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1578 microversion: 2.1 time: 0.171855 May 28 17:34:29.469928 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 459/934] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:34:29 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1578 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:34:29.897669 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1ddf3039-772a-41b3-8e6e-5c66d8b13cbd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:29.898275 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1ddf3039-772a-41b3-8e6e-5c66d8b13cbd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:29.904830 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1ddf3039-772a-41b3-8e6e-5c66d8b13cbd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:29.905275 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1ddf3039-772a-41b3-8e6e-5c66d8b13cbd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:29.906023 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1ddf3039-772a-41b3-8e6e-5c66d8b13cbd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:29.906452 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1ddf3039-772a-41b3-8e6e-5c66d8b13cbd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:30.037389 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1ddf3039-772a-41b3-8e6e-5c66d8b13cbd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:30.045167 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1ddf3039-772a-41b3-8e6e-5c66d8b13cbd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:30.046655 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1ddf3039-772a-41b3-8e6e-5c66d8b13cbd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:30.047831 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1ddf3039-772a-41b3-8e6e-5c66d8b13cbd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1723 microversion: 2.20 time: 0.154797 May 28 17:34:30.048386 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 476/935] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:29 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:34:30.487801 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4984e9c4-f3e6-46f8-afc6-8d2ce1246b44 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:30.488439 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4984e9c4-f3e6-46f8-afc6-8d2ce1246b44 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:30.494925 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4984e9c4-f3e6-46f8-afc6-8d2ce1246b44 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:30.495408 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4984e9c4-f3e6-46f8-afc6-8d2ce1246b44 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:30.496213 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4984e9c4-f3e6-46f8-afc6-8d2ce1246b44 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:30.496659 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4984e9c4-f3e6-46f8-afc6-8d2ce1246b44 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:30.627295 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4984e9c4-f3e6-46f8-afc6-8d2ce1246b44 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:30.635304 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4984e9c4-f3e6-46f8-afc6-8d2ce1246b44 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1578 microversion: 2.1 time: 0.152112 May 28 17:34:30.635897 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 460/936] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:34:30 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1578 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:34:31.066285 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0abebafd-77a6-4139-83b8-18285a6b8b8c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:31.066888 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0abebafd-77a6-4139-83b8-18285a6b8b8c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:31.073374 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0abebafd-77a6-4139-83b8-18285a6b8b8c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:31.073819 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0abebafd-77a6-4139-83b8-18285a6b8b8c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:31.074683 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0abebafd-77a6-4139-83b8-18285a6b8b8c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:31.075121 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0abebafd-77a6-4139-83b8-18285a6b8b8c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:31.202707 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0abebafd-77a6-4139-83b8-18285a6b8b8c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:31.211249 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0abebafd-77a6-4139-83b8-18285a6b8b8c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:31.212774 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0abebafd-77a6-4139-83b8-18285a6b8b8c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:31.213923 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0abebafd-77a6-4139-83b8-18285a6b8b8c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1723 microversion: 2.20 time: 0.151729 May 28 17:34:31.214467 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 477/937] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:31 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:34:31.652290 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3e73cafb-fb6b-4d24-98bd-0251180d2eb1 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:31.652910 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3e73cafb-fb6b-4d24-98bd-0251180d2eb1 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:31.659331 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3e73cafb-fb6b-4d24-98bd-0251180d2eb1 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:31.659806 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3e73cafb-fb6b-4d24-98bd-0251180d2eb1 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:31.660564 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3e73cafb-fb6b-4d24-98bd-0251180d2eb1 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:31.661005 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3e73cafb-fb6b-4d24-98bd-0251180d2eb1 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:31.788934 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3e73cafb-fb6b-4d24-98bd-0251180d2eb1 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:31.796402 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3e73cafb-fb6b-4d24-98bd-0251180d2eb1 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1578 microversion: 2.1 time: 0.147980 May 28 17:34:31.796959 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 461/938] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:34:31 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1578 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:34:32.232182 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0a31f3e4-9754-4130-b49b-6f2c5246b170 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:32.233122 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0a31f3e4-9754-4130-b49b-6f2c5246b170 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:32.240241 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0a31f3e4-9754-4130-b49b-6f2c5246b170 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:32.240684 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0a31f3e4-9754-4130-b49b-6f2c5246b170 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:32.241435 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0a31f3e4-9754-4130-b49b-6f2c5246b170 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:32.241864 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0a31f3e4-9754-4130-b49b-6f2c5246b170 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:32.372238 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0a31f3e4-9754-4130-b49b-6f2c5246b170 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:32.380426 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0a31f3e4-9754-4130-b49b-6f2c5246b170 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:32.382179 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0a31f3e4-9754-4130-b49b-6f2c5246b170 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:32.383330 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0a31f3e4-9754-4130-b49b-6f2c5246b170 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1723 microversion: 2.20 time: 0.155077 May 28 17:34:32.383904 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 478/939] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:32 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:34:32.813716 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-77dfa138-9305-4e24-906d-35253c5038b5 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:32.814331 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-77dfa138-9305-4e24-906d-35253c5038b5 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:32.821364 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-77dfa138-9305-4e24-906d-35253c5038b5 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:32.821806 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-77dfa138-9305-4e24-906d-35253c5038b5 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:32.822569 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-77dfa138-9305-4e24-906d-35253c5038b5 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:32.823002 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-77dfa138-9305-4e24-906d-35253c5038b5 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:32.840708 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:34:33.260781 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-77dfa138-9305-4e24-906d-35253c5038b5 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:33.269035 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-77dfa138-9305-4e24-906d-35253c5038b5 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1578 microversion: 2.1 time: 0.458957 May 28 17:34:33.269604 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 462/940] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:34:32 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1578 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:34:33.401956 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-bafae681-1275-42b2-bb4d-4c338a099e1e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:33.402569 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-bafae681-1275-42b2-bb4d-4c338a099e1e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:33.409784 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bafae681-1275-42b2-bb4d-4c338a099e1e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:33.410233 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bafae681-1275-42b2-bb4d-4c338a099e1e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:33.410992 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bafae681-1275-42b2-bb4d-4c338a099e1e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:33.411459 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bafae681-1275-42b2-bb4d-4c338a099e1e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:33.538827 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-bafae681-1275-42b2-bb4d-4c338a099e1e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:33.546676 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-bafae681-1275-42b2-bb4d-4c338a099e1e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:33.548212 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-bafae681-1275-42b2-bb4d-4c338a099e1e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:33.549378 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-bafae681-1275-42b2-bb4d-4c338a099e1e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1723 microversion: 2.20 time: 0.151349 May 28 17:34:33.549932 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 479/941] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:33 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:34:34.286647 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-59d4f083-d36b-48f9-9bbb-a13633f7c926 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:34.287251 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-59d4f083-d36b-48f9-9bbb-a13633f7c926 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:34.293642 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-59d4f083-d36b-48f9-9bbb-a13633f7c926 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:34.294087 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-59d4f083-d36b-48f9-9bbb-a13633f7c926 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:34.294835 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-59d4f083-d36b-48f9-9bbb-a13633f7c926 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:34.295269 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-59d4f083-d36b-48f9-9bbb-a13633f7c926 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:34.426512 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-59d4f083-d36b-48f9-9bbb-a13633f7c926 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:34.436003 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-59d4f083-d36b-48f9-9bbb-a13633f7c926 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1578 microversion: 2.1 time: 0.153458 May 28 17:34:34.437081 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 463/942] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:34:34 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:34:34.567526 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b08ec25c-78e2-4acb-9c90-0dfc60e31265 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:34.568084 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b08ec25c-78e2-4acb-9c90-0dfc60e31265 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:34.574868 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b08ec25c-78e2-4acb-9c90-0dfc60e31265 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:34.575321 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b08ec25c-78e2-4acb-9c90-0dfc60e31265 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:34.576106 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b08ec25c-78e2-4acb-9c90-0dfc60e31265 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:34.576545 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b08ec25c-78e2-4acb-9c90-0dfc60e31265 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:34.704168 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b08ec25c-78e2-4acb-9c90-0dfc60e31265 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:34.715283 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b08ec25c-78e2-4acb-9c90-0dfc60e31265 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:34.717392 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b08ec25c-78e2-4acb-9c90-0dfc60e31265 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:34.718595 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b08ec25c-78e2-4acb-9c90-0dfc60e31265 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1723 microversion: 2.20 time: 0.155171 May 28 17:34:34.719155 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 480/943] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:34 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:34:35.454052 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d2953e2e-ec33-4e43-9d89-92438d6f6423 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:35.454669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d2953e2e-ec33-4e43-9d89-92438d6f6423 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:35.461730 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d2953e2e-ec33-4e43-9d89-92438d6f6423 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:35.462180 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d2953e2e-ec33-4e43-9d89-92438d6f6423 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:35.462942 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d2953e2e-ec33-4e43-9d89-92438d6f6423 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:35.463401 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d2953e2e-ec33-4e43-9d89-92438d6f6423 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:35.590756 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d2953e2e-ec33-4e43-9d89-92438d6f6423 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:35.598961 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d2953e2e-ec33-4e43-9d89-92438d6f6423 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1578 microversion: 2.1 time: 0.148789 May 28 17:34:35.599540 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 464/944] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:34:35 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1578 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:34:35.738026 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8c3cb92a-3291-4103-aef8-d3396d73a1bc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:35.738867 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8c3cb92a-3291-4103-aef8-d3396d73a1bc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:35.745363 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8c3cb92a-3291-4103-aef8-d3396d73a1bc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:35.745805 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8c3cb92a-3291-4103-aef8-d3396d73a1bc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:35.746559 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8c3cb92a-3291-4103-aef8-d3396d73a1bc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:35.746986 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8c3cb92a-3291-4103-aef8-d3396d73a1bc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:35.878260 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8c3cb92a-3291-4103-aef8-d3396d73a1bc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:35.886955 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8c3cb92a-3291-4103-aef8-d3396d73a1bc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:35.888491 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8c3cb92a-3291-4103-aef8-d3396d73a1bc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:35.889667 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8c3cb92a-3291-4103-aef8-d3396d73a1bc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1723 microversion: 2.20 time: 0.155616 May 28 17:34:35.890226 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 481/945] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:35 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:34:36.616314 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5d4f1d00-3fd6-48fb-8521-fd6f988f1162 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:36.616938 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5d4f1d00-3fd6-48fb-8521-fd6f988f1162 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:36.623363 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5d4f1d00-3fd6-48fb-8521-fd6f988f1162 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:36.623818 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5d4f1d00-3fd6-48fb-8521-fd6f988f1162 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:36.624583 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5d4f1d00-3fd6-48fb-8521-fd6f988f1162 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:36.625022 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5d4f1d00-3fd6-48fb-8521-fd6f988f1162 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:36.764652 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5d4f1d00-3fd6-48fb-8521-fd6f988f1162 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:36.775496 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5d4f1d00-3fd6-48fb-8521-fd6f988f1162 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1578 microversion: 2.1 time: 0.163788 May 28 17:34:36.776070 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 465/946] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:34:36 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:34:36.908756 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4b014c2b-a3f9-48b5-aea7-a1319c9f1550 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:36.909368 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-4b014c2b-a3f9-48b5-aea7-a1319c9f1550 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:36.916642 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4b014c2b-a3f9-48b5-aea7-a1319c9f1550 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:36.917094 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4b014c2b-a3f9-48b5-aea7-a1319c9f1550 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:36.917858 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4b014c2b-a3f9-48b5-aea7-a1319c9f1550 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:36.918295 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4b014c2b-a3f9-48b5-aea7-a1319c9f1550 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:37.046301 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-4b014c2b-a3f9-48b5-aea7-a1319c9f1550 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:37.054287 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-4b014c2b-a3f9-48b5-aea7-a1319c9f1550 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:37.055822 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-4b014c2b-a3f9-48b5-aea7-a1319c9f1550 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:37.056983 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-4b014c2b-a3f9-48b5-aea7-a1319c9f1550 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1723 microversion: 2.20 time: 0.152239 May 28 17:34:37.057572 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 482/947] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:36 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:34:37.792632 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-57154570-6f31-419f-9ca8-650163709563 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:37.793262 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-57154570-6f31-419f-9ca8-650163709563 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:37.799998 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-57154570-6f31-419f-9ca8-650163709563 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:37.801067 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-57154570-6f31-419f-9ca8-650163709563 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:37.801945 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-57154570-6f31-419f-9ca8-650163709563 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:37.802391 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-57154570-6f31-419f-9ca8-650163709563 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:37.933050 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-57154570-6f31-419f-9ca8-650163709563 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:37.940577 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-57154570-6f31-419f-9ca8-650163709563 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1578 microversion: 2.1 time: 0.151873 May 28 17:34:37.941265 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 466/948] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:34:37 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1578 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:34:38.075198 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0d5bf441-4432-45f3-8f5d-0db937bd1d46 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:38.075806 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0d5bf441-4432-45f3-8f5d-0db937bd1d46 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:38.082369 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0d5bf441-4432-45f3-8f5d-0db937bd1d46 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:38.082822 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0d5bf441-4432-45f3-8f5d-0db937bd1d46 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:38.083649 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0d5bf441-4432-45f3-8f5d-0db937bd1d46 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:38.084090 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0d5bf441-4432-45f3-8f5d-0db937bd1d46 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:38.227686 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0d5bf441-4432-45f3-8f5d-0db937bd1d46 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:38.235707 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0d5bf441-4432-45f3-8f5d-0db937bd1d46 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:38.237209 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0d5bf441-4432-45f3-8f5d-0db937bd1d46 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:38.239019 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0d5bf441-4432-45f3-8f5d-0db937bd1d46 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1723 microversion: 2.20 time: 0.167785 May 28 17:34:38.239599 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 483/949] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:38 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:34:38.959080 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-695c0961-077e-47ee-937b-40ff7b153179 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:38.959725 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-695c0961-077e-47ee-937b-40ff7b153179 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:38.966433 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-695c0961-077e-47ee-937b-40ff7b153179 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:38.966888 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-695c0961-077e-47ee-937b-40ff7b153179 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:38.967679 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-695c0961-077e-47ee-937b-40ff7b153179 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:38.968116 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-695c0961-077e-47ee-937b-40ff7b153179 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:38.981043 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-2b19954f-17e0-4adc-924b-4716b009d8a8 req-fbb422bc-f11a-4be4-96ff-c370cdbd4d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "281e6309-8591-49e7-ab2a-e36aa0fad594", "name": "network-vif-plugged", "status": "completed", "tag": "50d0ffcf-e908-48f5-9b29-2b70709081b6"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:34:38.990481 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-2b19954f-17e0-4adc-924b-4716b009d8a8 req-fbb422bc-f11a-4be4-96ff-c370cdbd4d3d service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:38.991079 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-2b19954f-17e0-4adc-924b-4716b009d8a8 req-fbb422bc-f11a-4be4-96ff-c370cdbd4d3d service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:39.006653 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-2b19954f-17e0-4adc-924b-4716b009d8a8 req-fbb422bc-f11a-4be4-96ff-c370cdbd4d3d service nova] Creating event network-vif-plugged:50d0ffcf-e908-48f5-9b29-2b70709081b6 for instance 281e6309-8591-49e7-ab2a-e36aa0fad594 on hv-cinder-84372 May 28 17:34:39.011836 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-2b19954f-17e0-4adc-924b-4716b009d8a8 req-fbb422bc-f11a-4be4-96ff-c370cdbd4d3d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037055 May 28 17:34:39.013022 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 484/950] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:34:39.149934 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-695c0961-077e-47ee-937b-40ff7b153179 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:39.157758 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-695c0961-077e-47ee-937b-40ff7b153179 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1578 microversion: 2.1 time: 0.203903 May 28 17:34:39.158478 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 467/951] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:34:38 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1578 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:34:39.259304 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-658f2bc8-316e-43f5-bb24-6c8c5c728bdd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:39.260007 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-658f2bc8-316e-43f5-bb24-6c8c5c728bdd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:39.266249 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-658f2bc8-316e-43f5-bb24-6c8c5c728bdd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:39.266698 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-658f2bc8-316e-43f5-bb24-6c8c5c728bdd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:39.267476 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-658f2bc8-316e-43f5-bb24-6c8c5c728bdd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:39.267911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-658f2bc8-316e-43f5-bb24-6c8c5c728bdd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:39.410321 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-658f2bc8-316e-43f5-bb24-6c8c5c728bdd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:39.418278 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-658f2bc8-316e-43f5-bb24-6c8c5c728bdd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:39.419807 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-658f2bc8-316e-43f5-bb24-6c8c5c728bdd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:39.420966 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-658f2bc8-316e-43f5-bb24-6c8c5c728bdd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1744 microversion: 2.20 time: 0.167643 May 28 17:34:39.421518 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 485/952] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:39 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:34:40.175072 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a4799a6b-4364-4048-abf1-65b0b4c446ed tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:40.175874 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a4799a6b-4364-4048-abf1-65b0b4c446ed tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:40.182264 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a4799a6b-4364-4048-abf1-65b0b4c446ed tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:40.182713 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a4799a6b-4364-4048-abf1-65b0b4c446ed tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:40.183502 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a4799a6b-4364-4048-abf1-65b0b4c446ed tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:40.183938 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a4799a6b-4364-4048-abf1-65b0b4c446ed tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:40.311636 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a4799a6b-4364-4048-abf1-65b0b4c446ed tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:40.319693 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a4799a6b-4364-4048-abf1-65b0b4c446ed tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1578 microversion: 2.1 time: 0.148545 May 28 17:34:40.320259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 468/953] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:34:40 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1578 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:34:40.444964 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b66d5643-d7a9-4d4d-a984-018f0e4a7a70 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:40.445606 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b66d5643-d7a9-4d4d-a984-018f0e4a7a70 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:40.452553 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b66d5643-d7a9-4d4d-a984-018f0e4a7a70 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:40.453000 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b66d5643-d7a9-4d4d-a984-018f0e4a7a70 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:40.453768 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b66d5643-d7a9-4d4d-a984-018f0e4a7a70 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:40.454222 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b66d5643-d7a9-4d4d-a984-018f0e4a7a70 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:40.598239 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b66d5643-d7a9-4d4d-a984-018f0e4a7a70 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:40.606076 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b66d5643-d7a9-4d4d-a984-018f0e4a7a70 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:40.607627 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b66d5643-d7a9-4d4d-a984-018f0e4a7a70 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:40.608776 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b66d5643-d7a9-4d4d-a984-018f0e4a7a70 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1744 microversion: 2.20 time: 0.169381 May 28 17:34:40.609334 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 486/954] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:40 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:34:41.327424 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-16b120b1-9689-43b5-9a10-b7749458a064 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:41.327990 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-16b120b1-9689-43b5-9a10-b7749458a064 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:41.335973 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-16b120b1-9689-43b5-9a10-b7749458a064 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:41.336421 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-16b120b1-9689-43b5-9a10-b7749458a064 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:41.336963 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2623fc77-e434-4f32-80ec-8c7176b9beb4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:41.337358 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-16b120b1-9689-43b5-9a10-b7749458a064 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:41.337801 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-16b120b1-9689-43b5-9a10-b7749458a064 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:41.337907 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2623fc77-e434-4f32-80ec-8c7176b9beb4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:41.344221 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2623fc77-e434-4f32-80ec-8c7176b9beb4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:41.344689 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2623fc77-e434-4f32-80ec-8c7176b9beb4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:41.345481 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2623fc77-e434-4f32-80ec-8c7176b9beb4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:41.345918 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2623fc77-e434-4f32-80ec-8c7176b9beb4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:41.365696 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-16b120b1-9689-43b5-9a10-b7749458a064 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2/ips" status: 200 len: 146 microversion: 2.1 time: 0.042345 May 28 17:34:41.366277 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 469/955] 10.222.0.33 () {58 vars in 1247 bytes} [Sat May 28 17:34:41 2022] GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2/ips => generated 146 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:34:41.482187 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-2623fc77-e434-4f32-80ec-8c7176b9beb4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:41.490240 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2623fc77-e434-4f32-80ec-8c7176b9beb4 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1565 microversion: 2.1 time: 0.157118 May 28 17:34:41.490802 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 487/956] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:34:41 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:34:41.627472 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d3eaf186-b934-41f0-bc1f-7de542bb6a50 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:41.628576 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d3eaf186-b934-41f0-bc1f-7de542bb6a50 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:41.636201 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d3eaf186-b934-41f0-bc1f-7de542bb6a50 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:41.636726 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d3eaf186-b934-41f0-bc1f-7de542bb6a50 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:41.637363 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d3eaf186-b934-41f0-bc1f-7de542bb6a50 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:41.637798 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d3eaf186-b934-41f0-bc1f-7de542bb6a50 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:41.771011 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d3eaf186-b934-41f0-bc1f-7de542bb6a50 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:41.778904 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d3eaf186-b934-41f0-bc1f-7de542bb6a50 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:41.780446 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d3eaf186-b934-41f0-bc1f-7de542bb6a50 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:41.781602 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d3eaf186-b934-41f0-bc1f-7de542bb6a50 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1744 microversion: 2.20 time: 0.158051 May 28 17:34:41.782159 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 470/957] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:41 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:34:42.799944 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-26c3467a-0320-499e-a567-0dac9ab2bbd0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:42.800556 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-26c3467a-0320-499e-a567-0dac9ab2bbd0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:42.802984 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=53 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:34:42.808975 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-26c3467a-0320-499e-a567-0dac9ab2bbd0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:42.809431 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-26c3467a-0320-499e-a567-0dac9ab2bbd0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:42.810233 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-26c3467a-0320-499e-a567-0dac9ab2bbd0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:42.810671 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-26c3467a-0320-499e-a567-0dac9ab2bbd0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:42.941489 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-26c3467a-0320-499e-a567-0dac9ab2bbd0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:42.950161 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-26c3467a-0320-499e-a567-0dac9ab2bbd0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:42.951548 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-26c3467a-0320-499e-a567-0dac9ab2bbd0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:42.952978 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-26c3467a-0320-499e-a567-0dac9ab2bbd0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1744 microversion: 2.20 time: 0.156858 May 28 17:34:42.953833 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 488/958] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:42 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:34:43.105824 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-16aaff34-b3c0-4587-a348-a52792861032 req-300f50eb-3cb4-4e41-8d2b-6108c822245c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27322ac4-8704-4f1a-b431-e5c4ad7d77ad", "name": "network-vif-plugged", "status": "completed", "tag": "e951fe87-910c-4495-88e9-a876c275be25"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:34:43.109920 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=53 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:34:43.115444 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-16aaff34-b3c0-4587-a348-a52792861032 req-300f50eb-3cb4-4e41-8d2b-6108c822245c service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:43.115895 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-16aaff34-b3c0-4587-a348-a52792861032 req-300f50eb-3cb4-4e41-8d2b-6108c822245c service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:43.127514 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-16aaff34-b3c0-4587-a348-a52792861032 req-300f50eb-3cb4-4e41-8d2b-6108c822245c service nova] Creating event network-vif-plugged:e951fe87-910c-4495-88e9-a876c275be25 for instance 27322ac4-8704-4f1a-b431-e5c4ad7d77ad on hv-cinder-84372 May 28 17:34:43.133240 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-16aaff34-b3c0-4587-a348-a52792861032 req-300f50eb-3cb4-4e41-8d2b-6108c822245c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031076 May 28 17:34:43.133843 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 471/959] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:34:43.739004 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-168b4ee4-cc67-4213-bb81-d80072d2ea07 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58351ef1-8f0c-4990-9355-38d2e1f1650e"}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:34:43.740193 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-168b4ee4-cc67-4213-bb81-d80072d2ea07 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:43.746404 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-168b4ee4-cc67-4213-bb81-d80072d2ea07 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:43.746861 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-168b4ee4-cc67-4213-bb81-d80072d2ea07 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:43.747656 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-168b4ee4-cc67-4213-bb81-d80072d2ea07 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:43.748098 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-168b4ee4-cc67-4213-bb81-d80072d2ea07 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:43.973022 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1fac14af-ae35-4ca5-b82b-d136e96e7814 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:43.973843 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1fac14af-ae35-4ca5-b82b-d136e96e7814 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:43.980086 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1fac14af-ae35-4ca5-b82b-d136e96e7814 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:43.980537 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1fac14af-ae35-4ca5-b82b-d136e96e7814 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:43.981314 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1fac14af-ae35-4ca5-b82b-d136e96e7814 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:43.981752 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1fac14af-ae35-4ca5-b82b-d136e96e7814 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:44.002597 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-168b4ee4-cc67-4213-bb81-d80072d2ea07 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "POST /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268163 May 28 17:34:44.003679 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 489/960] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 17:34:43 2022] POST /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:34:44.123647 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1fac14af-ae35-4ca5-b82b-d136e96e7814 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:44.132544 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1fac14af-ae35-4ca5-b82b-d136e96e7814 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:44.134033 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1fac14af-ae35-4ca5-b82b-d136e96e7814 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:44.135190 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1fac14af-ae35-4ca5-b82b-d136e96e7814 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1744 microversion: 2.20 time: 0.167217 May 28 17:34:44.135775 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 472/961] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:43 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:34:45.155502 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-aa7566b9-3dba-4ab5-ac5b-35e7d8c9bc5b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:45.156841 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-aa7566b9-3dba-4ab5-ac5b-35e7d8c9bc5b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:45.164634 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aa7566b9-3dba-4ab5-ac5b-35e7d8c9bc5b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:45.165088 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aa7566b9-3dba-4ab5-ac5b-35e7d8c9bc5b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:45.165998 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aa7566b9-3dba-4ab5-ac5b-35e7d8c9bc5b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:45.166440 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aa7566b9-3dba-4ab5-ac5b-35e7d8c9bc5b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:45.184907 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:34:45.325999 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-aa7566b9-3dba-4ab5-ac5b-35e7d8c9bc5b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:45.335795 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-aa7566b9-3dba-4ab5-ac5b-35e7d8c9bc5b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:45.337613 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-aa7566b9-3dba-4ab5-ac5b-35e7d8c9bc5b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:45.338864 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-aa7566b9-3dba-4ab5-ac5b-35e7d8c9bc5b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1739 microversion: 2.20 time: 0.188313 May 28 17:34:45.339935 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 490/962] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:45 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:34:46.358047 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-bfe8789f-aab5-477e-a53d-850b11b72853 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:46.358659 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-bfe8789f-aab5-477e-a53d-850b11b72853 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:46.366313 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bfe8789f-aab5-477e-a53d-850b11b72853 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:46.366765 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bfe8789f-aab5-477e-a53d-850b11b72853 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:46.367773 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bfe8789f-aab5-477e-a53d-850b11b72853 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:46.368209 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bfe8789f-aab5-477e-a53d-850b11b72853 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:46.534056 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bfe8789f-aab5-477e-a53d-850b11b72853 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:46.544132 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bfe8789f-aab5-477e-a53d-850b11b72853 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:46.546014 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bfe8789f-aab5-477e-a53d-850b11b72853 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:46.547419 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-bfe8789f-aab5-477e-a53d-850b11b72853 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1739 microversion: 2.20 time: 0.193374 May 28 17:34:46.552669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 473/963] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:46 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:34:47.567460 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-81b6c592-7a32-4d1b-b815-8cd8f4c4317f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:47.568365 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-81b6c592-7a32-4d1b-b815-8cd8f4c4317f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:47.576991 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-81b6c592-7a32-4d1b-b815-8cd8f4c4317f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:47.577427 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-81b6c592-7a32-4d1b-b815-8cd8f4c4317f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:47.578246 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-81b6c592-7a32-4d1b-b815-8cd8f4c4317f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:47.578678 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-81b6c592-7a32-4d1b-b815-8cd8f4c4317f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:47.738604 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-81b6c592-7a32-4d1b-b815-8cd8f4c4317f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:47.748922 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-81b6c592-7a32-4d1b-b815-8cd8f4c4317f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:47.750253 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-81b6c592-7a32-4d1b-b815-8cd8f4c4317f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:47.751450 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-81b6c592-7a32-4d1b-b815-8cd8f4c4317f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1739 microversion: 2.20 time: 0.188494 May 28 17:34:47.752007 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 491/964] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:47 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:34:48.770389 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a4911158-195b-46e8-b4af-6b8126d653da tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:48.771093 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a4911158-195b-46e8-b4af-6b8126d653da tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:48.777814 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a4911158-195b-46e8-b4af-6b8126d653da tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:48.778278 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a4911158-195b-46e8-b4af-6b8126d653da tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:48.779117 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a4911158-195b-46e8-b4af-6b8126d653da tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:48.779589 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a4911158-195b-46e8-b4af-6b8126d653da tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:48.934693 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a4911158-195b-46e8-b4af-6b8126d653da tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:48.943773 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a4911158-195b-46e8-b4af-6b8126d653da tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:48.945282 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a4911158-195b-46e8-b4af-6b8126d653da tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:48.946623 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a4911158-195b-46e8-b4af-6b8126d653da tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1739 microversion: 2.20 time: 0.180149 May 28 17:34:48.947470 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 474/965] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:48 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:34:49.965164 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6ab62656-abdf-467d-abd4-60d950cf6f53 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:49.965911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6ab62656-abdf-467d-abd4-60d950cf6f53 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:49.973176 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6ab62656-abdf-467d-abd4-60d950cf6f53 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:49.973584 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6ab62656-abdf-467d-abd4-60d950cf6f53 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:49.974501 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6ab62656-abdf-467d-abd4-60d950cf6f53 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:49.974949 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6ab62656-abdf-467d-abd4-60d950cf6f53 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:50.121137 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6ab62656-abdf-467d-abd4-60d950cf6f53 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:50.130326 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6ab62656-abdf-467d-abd4-60d950cf6f53 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:50.132147 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6ab62656-abdf-467d-abd4-60d950cf6f53 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:50.133322 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6ab62656-abdf-467d-abd4-60d950cf6f53 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1739 microversion: 2.20 time: 0.172371 May 28 17:34:50.134176 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 492/966] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:49 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:34:51.152277 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3185a7af-c649-48a1-a445-cf2adc76c6d5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:51.152826 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3185a7af-c649-48a1-a445-cf2adc76c6d5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:51.162690 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3185a7af-c649-48a1-a445-cf2adc76c6d5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:51.163494 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3185a7af-c649-48a1-a445-cf2adc76c6d5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:51.164486 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3185a7af-c649-48a1-a445-cf2adc76c6d5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:51.165104 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3185a7af-c649-48a1-a445-cf2adc76c6d5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:51.323274 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3185a7af-c649-48a1-a445-cf2adc76c6d5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:51.333407 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3185a7af-c649-48a1-a445-cf2adc76c6d5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:51.335486 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3185a7af-c649-48a1-a445-cf2adc76c6d5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:51.337013 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3185a7af-c649-48a1-a445-cf2adc76c6d5 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1739 microversion: 2.20 time: 0.189459 May 28 17:34:51.337973 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 475/967] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:51 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:34:51.565031 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d524f896-67d7-4d47-9b47-deb8ca534f93 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:51.567544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d524f896-67d7-4d47-9b47-deb8ca534f93 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:51.574667 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d524f896-67d7-4d47-9b47-deb8ca534f93 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:51.575358 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d524f896-67d7-4d47-9b47-deb8ca534f93 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:51.576494 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d524f896-67d7-4d47-9b47-deb8ca534f93 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:51.577119 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d524f896-67d7-4d47-9b47-deb8ca534f93 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:51.611227 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d524f896-67d7-4d47-9b47-deb8ca534f93 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050122 May 28 17:34:51.611987 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 493/968] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 17:34:51 2022] GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:34:51.622155 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a01b3e50-ee94-41b6-8e56-cde2f850a18c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:51.622663 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a01b3e50-ee94-41b6-8e56-cde2f850a18c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:51.629487 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a01b3e50-ee94-41b6-8e56-cde2f850a18c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:51.630346 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a01b3e50-ee94-41b6-8e56-cde2f850a18c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:51.631040 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a01b3e50-ee94-41b6-8e56-cde2f850a18c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:51.631663 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a01b3e50-ee94-41b6-8e56-cde2f850a18c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:51.666801 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a01b3e50-ee94-41b6-8e56-cde2f850a18c tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2/os-volume_attachments/58351ef1-8f0c-4990-9355-38d2e1f1650e" status: 200 len: 194 microversion: 2.1 time: 0.048567 May 28 17:34:51.671611 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 476/969] 10.222.0.33 () {58 vars in 1412 bytes} [Sat May 28 17:34:51 2022] GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2/os-volume_attachments/58351ef1-8f0c-4990-9355-38d2e1f1650e => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:34:52.355415 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-064a76a6-48e2-4fea-a006-a4e552be4faf tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:52.356054 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-064a76a6-48e2-4fea-a006-a4e552be4faf tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:52.362756 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-064a76a6-48e2-4fea-a006-a4e552be4faf tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:52.363785 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-064a76a6-48e2-4fea-a006-a4e552be4faf tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:52.364542 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-064a76a6-48e2-4fea-a006-a4e552be4faf tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:52.364978 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-064a76a6-48e2-4fea-a006-a4e552be4faf tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:52.522413 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-064a76a6-48e2-4fea-a006-a4e552be4faf tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:52.531033 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-064a76a6-48e2-4fea-a006-a4e552be4faf tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:52.532644 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-064a76a6-48e2-4fea-a006-a4e552be4faf tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:52.533853 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-064a76a6-48e2-4fea-a006-a4e552be4faf tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1739 microversion: 2.20 time: 0.182492 May 28 17:34:52.545495 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 494/970] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:52 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:34:53.067153 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5da1d525-7b73-4ec2-9a47-fa3099b0b5c8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c211d40b-ef43-4a99-ae5f-f824a82cae3b"}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:34:53.068271 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5da1d525-7b73-4ec2-9a47-fa3099b0b5c8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:53.075097 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5da1d525-7b73-4ec2-9a47-fa3099b0b5c8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:53.075589 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5da1d525-7b73-4ec2-9a47-fa3099b0b5c8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:53.076377 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5da1d525-7b73-4ec2-9a47-fa3099b0b5c8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:53.076818 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5da1d525-7b73-4ec2-9a47-fa3099b0b5c8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:53.421039 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5da1d525-7b73-4ec2-9a47-fa3099b0b5c8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "POST /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.357618 May 28 17:34:53.422534 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 477/971] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 17:34:53 2022] POST /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2/os-volume_attachments => generated 194 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:34:53.553934 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-00e0d7b3-ff02-489e-a74c-98347a047cd0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:53.554687 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-00e0d7b3-ff02-489e-a74c-98347a047cd0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:53.561541 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-00e0d7b3-ff02-489e-a74c-98347a047cd0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:53.562035 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-00e0d7b3-ff02-489e-a74c-98347a047cd0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:53.563258 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-00e0d7b3-ff02-489e-a74c-98347a047cd0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:53.563916 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-00e0d7b3-ff02-489e-a74c-98347a047cd0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:53.720759 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-00e0d7b3-ff02-489e-a74c-98347a047cd0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:53.732080 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-00e0d7b3-ff02-489e-a74c-98347a047cd0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:53.734337 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-00e0d7b3-ff02-489e-a74c-98347a047cd0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:53.735549 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-00e0d7b3-ff02-489e-a74c-98347a047cd0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1739 microversion: 2.20 time: 0.186710 May 28 17:34:53.736098 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 495/972] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:53 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:34:54.755178 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8c4d42c5-5592-4834-ab1d-f8c879bfabf4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:54.755947 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8c4d42c5-5592-4834-ab1d-f8c879bfabf4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:54.762575 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8c4d42c5-5592-4834-ab1d-f8c879bfabf4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:54.763036 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8c4d42c5-5592-4834-ab1d-f8c879bfabf4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:54.763838 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8c4d42c5-5592-4834-ab1d-f8c879bfabf4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:54.764283 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8c4d42c5-5592-4834-ab1d-f8c879bfabf4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:54.895800 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8c4d42c5-5592-4834-ab1d-f8c879bfabf4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:54.898114 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:34:54.904897 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8c4d42c5-5592-4834-ab1d-f8c879bfabf4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:54.906399 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8c4d42c5-5592-4834-ab1d-f8c879bfabf4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:54.907587 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8c4d42c5-5592-4834-ab1d-f8c879bfabf4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1739 microversion: 2.20 time: 0.157323 May 28 17:34:54.908139 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 478/973] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:54 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:34:55.925150 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0e154f4c-cda0-4b3e-b27d-ad9da43b40eb tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:55.925724 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0e154f4c-cda0-4b3e-b27d-ad9da43b40eb tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:55.933488 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0e154f4c-cda0-4b3e-b27d-ad9da43b40eb tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:55.933932 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0e154f4c-cda0-4b3e-b27d-ad9da43b40eb tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:55.934681 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0e154f4c-cda0-4b3e-b27d-ad9da43b40eb tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:55.935111 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0e154f4c-cda0-4b3e-b27d-ad9da43b40eb tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:56.068482 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0e154f4c-cda0-4b3e-b27d-ad9da43b40eb tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:56.076316 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0e154f4c-cda0-4b3e-b27d-ad9da43b40eb tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:56.077811 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0e154f4c-cda0-4b3e-b27d-ad9da43b40eb tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:56.078957 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0e154f4c-cda0-4b3e-b27d-ad9da43b40eb tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1721 microversion: 2.20 time: 0.157821 May 28 17:34:56.079533 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 496/974] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:55 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:34:57.097209 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1fd65a26-3e74-482f-8e89-6472d4784f0c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:57.097770 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1fd65a26-3e74-482f-8e89-6472d4784f0c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:57.105561 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1fd65a26-3e74-482f-8e89-6472d4784f0c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:57.106016 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1fd65a26-3e74-482f-8e89-6472d4784f0c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:57.106789 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1fd65a26-3e74-482f-8e89-6472d4784f0c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:57.107232 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1fd65a26-3e74-482f-8e89-6472d4784f0c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:57.236431 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1fd65a26-3e74-482f-8e89-6472d4784f0c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:57.244863 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1fd65a26-3e74-482f-8e89-6472d4784f0c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:57.246379 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1fd65a26-3e74-482f-8e89-6472d4784f0c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:57.247573 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1fd65a26-3e74-482f-8e89-6472d4784f0c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1721 microversion: 2.20 time: 0.154310 May 28 17:34:57.248133 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 479/975] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:57 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:34:58.267247 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4f7d9c2d-7f9a-4029-a89e-fd071ee9ae2c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:58.267953 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-4f7d9c2d-7f9a-4029-a89e-fd071ee9ae2c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:58.274806 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4f7d9c2d-7f9a-4029-a89e-fd071ee9ae2c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:58.275255 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4f7d9c2d-7f9a-4029-a89e-fd071ee9ae2c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:58.276043 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4f7d9c2d-7f9a-4029-a89e-fd071ee9ae2c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:58.276475 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4f7d9c2d-7f9a-4029-a89e-fd071ee9ae2c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:58.402468 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-4f7d9c2d-7f9a-4029-a89e-fd071ee9ae2c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:58.410763 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-4f7d9c2d-7f9a-4029-a89e-fd071ee9ae2c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:58.413087 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-4f7d9c2d-7f9a-4029-a89e-fd071ee9ae2c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:58.414313 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-4f7d9c2d-7f9a-4029-a89e-fd071ee9ae2c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1664 microversion: 2.20 time: 0.150963 May 28 17:34:58.414877 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 497/976] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:58 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1664 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:34:58.432217 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-59f908ea-3567-463e-af1d-eef7e68f28aa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "522b4584-cce7-4775-9054-c26001c5ba17"}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:34:58.433331 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-59f908ea-3567-463e-af1d-eef7e68f28aa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:58.439749 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-59f908ea-3567-463e-af1d-eef7e68f28aa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:58.440197 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-59f908ea-3567-463e-af1d-eef7e68f28aa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:58.440958 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-59f908ea-3567-463e-af1d-eef7e68f28aa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:58.441395 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-59f908ea-3567-463e-af1d-eef7e68f28aa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:58.700970 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-59f908ea-3567-463e-af1d-eef7e68f28aa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "POST /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.272847 May 28 17:34:58.701560 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 480/977] 10.222.0.33 () {62 vars in 1363 bytes} [Sat May 28 17:34:58 2022] POST /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad/os-volume_attachments => generated 188 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 17:34:58.817029 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e5a22c68-73b1-46f8-8364-40fcc564697f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:58.818386 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e5a22c68-73b1-46f8-8364-40fcc564697f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:58.824419 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e5a22c68-73b1-46f8-8364-40fcc564697f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:58.824862 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e5a22c68-73b1-46f8-8364-40fcc564697f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:58.825615 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e5a22c68-73b1-46f8-8364-40fcc564697f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:58.826043 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e5a22c68-73b1-46f8-8364-40fcc564697f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:59.073489 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e5a22c68-73b1-46f8-8364-40fcc564697f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "DELETE /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad/os-volume_attachments/522b4584-cce7-4775-9054-c26001c5ba17" status: 202 len: 0 microversion: 2.20 time: 0.260302 May 28 17:34:59.074125 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 498/978] 10.222.0.33 () {60 vars in 1456 bytes} [Sat May 28 17:34:58 2022] DELETE /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad/os-volume_attachments/522b4584-cce7-4775-9054-c26001c5ba17 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 17:34:59.104343 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-45517554-fd9d-4686-8134-21f1b47b5f17 req-b4f1d987-3f68-46f9-b37b-80930b5b3856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27322ac4-8704-4f1a-b431-e5c4ad7d77ad", "name": "network-vif-unplugged", "status": "completed", "tag": "e951fe87-910c-4495-88e9-a876c275be25"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:34:59.113283 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-45517554-fd9d-4686-8134-21f1b47b5f17 req-b4f1d987-3f68-46f9-b37b-80930b5b3856 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:59.113847 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-45517554-fd9d-4686-8134-21f1b47b5f17 req-b4f1d987-3f68-46f9-b37b-80930b5b3856 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:59.130543 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.compute.server_external_events [req-45517554-fd9d-4686-8134-21f1b47b5f17 req-b4f1d987-3f68-46f9-b37b-80930b5b3856 service nova] Unable to find a host for instance 27322ac4-8704-4f1a-b431-e5c4ad7d77ad. Dropping event network-vif-unplugged {{(pid=117605) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 28 17:34:59.132058 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-45517554-fd9d-4686-8134-21f1b47b5f17 req-b4f1d987-3f68-46f9-b37b-80930b5b3856 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031691 May 28 17:34:59.132860 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 481/979] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 28 17:34:59.134549 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e931f3c5-f34a-40d8-9b8c-b7cfb9d0ad72 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:34:59.135191 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e931f3c5-f34a-40d8-9b8c-b7cfb9d0ad72 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:59.142308 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e931f3c5-f34a-40d8-9b8c-b7cfb9d0ad72 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:59.142754 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e931f3c5-f34a-40d8-9b8c-b7cfb9d0ad72 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:59.143563 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e931f3c5-f34a-40d8-9b8c-b7cfb9d0ad72 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:59.144001 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e931f3c5-f34a-40d8-9b8c-b7cfb9d0ad72 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:59.234075 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e931f3c5-f34a-40d8-9b8c-b7cfb9d0ad72 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "POST /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad/action" status: 202 len: 0 microversion: 2.20 time: 0.105464 May 28 17:34:59.234679 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 499/980] 10.222.0.33 () {62 vars in 1318 bytes} [Sat May 28 17:34:59 2022] POST /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 28 17:34:59.243735 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a4431b2e-7fd8-4db1-b821-6e720bbfe29c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:34:59.244354 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a4431b2e-7fd8-4db1-b821-6e720bbfe29c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:34:59.250334 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a4431b2e-7fd8-4db1-b821-6e720bbfe29c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:59.250780 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a4431b2e-7fd8-4db1-b821-6e720bbfe29c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:59.251717 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a4431b2e-7fd8-4db1-b821-6e720bbfe29c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:34:59.252159 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a4431b2e-7fd8-4db1-b821-6e720bbfe29c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:34:59.392827 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a4431b2e-7fd8-4db1-b821-6e720bbfe29c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:59.401164 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a4431b2e-7fd8-4db1-b821-6e720bbfe29c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:59.403018 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a4431b2e-7fd8-4db1-b821-6e720bbfe29c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:34:59.404418 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a4431b2e-7fd8-4db1-b821-6e720bbfe29c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1672 microversion: 2.20 time: 0.165398 May 28 17:34:59.405038 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 482/981] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:34:59 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:35:00.423631 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-af72d900-2bd7-41ed-a5b4-264cd30d7403 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:00.424238 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-af72d900-2bd7-41ed-a5b4-264cd30d7403 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:00.431644 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-af72d900-2bd7-41ed-a5b4-264cd30d7403 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:00.432093 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-af72d900-2bd7-41ed-a5b4-264cd30d7403 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:00.432847 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-af72d900-2bd7-41ed-a5b4-264cd30d7403 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:00.433277 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-af72d900-2bd7-41ed-a5b4-264cd30d7403 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:00.562126 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-af72d900-2bd7-41ed-a5b4-264cd30d7403 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:00.570321 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-af72d900-2bd7-41ed-a5b4-264cd30d7403 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:00.571856 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-af72d900-2bd7-41ed-a5b4-264cd30d7403 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:00.573039 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-af72d900-2bd7-41ed-a5b4-264cd30d7403 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1674 microversion: 2.20 time: 0.153871 May 28 17:35:00.573593 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 500/982] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:35:00 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:35:00.956128 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9818cd02-390f-4371-9051-09915be08985 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:00.957109 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9818cd02-390f-4371-9051-09915be08985 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:00.965758 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9818cd02-390f-4371-9051-09915be08985 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:00.966220 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9818cd02-390f-4371-9051-09915be08985 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:00.966966 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9818cd02-390f-4371-9051-09915be08985 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:00.967426 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9818cd02-390f-4371-9051-09915be08985 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:00.997837 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9818cd02-390f-4371-9051-09915be08985 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045581 May 28 17:35:00.998387 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 483/983] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 17:35:00 2022] GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:35:01.151885 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-bc285228-29af-4d46-886f-866838aafad2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:01.152378 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-bc285228-29af-4d46-886f-866838aafad2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:01.158758 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bc285228-29af-4d46-886f-866838aafad2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:01.159205 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bc285228-29af-4d46-886f-866838aafad2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:01.159996 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bc285228-29af-4d46-886f-866838aafad2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:01.160427 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-bc285228-29af-4d46-886f-866838aafad2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:01.188634 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-bc285228-29af-4d46-886f-866838aafad2 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2/os-volume_attachments/58351ef1-8f0c-4990-9355-38d2e1f1650e" status: 200 len: 194 microversion: 2.1 time: 0.040614 May 28 17:35:01.189327 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 501/984] 10.222.0.33 () {58 vars in 1412 bytes} [Sat May 28 17:35:01 2022] GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2/os-volume_attachments/58351ef1-8f0c-4990-9355-38d2e1f1650e => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:35:01.199198 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-723ef0bd-0f39-446f-8cfe-e5b623d05cdc tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:01.199724 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-723ef0bd-0f39-446f-8cfe-e5b623d05cdc tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:01.205702 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-723ef0bd-0f39-446f-8cfe-e5b623d05cdc tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:01.206154 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-723ef0bd-0f39-446f-8cfe-e5b623d05cdc tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:01.206916 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-723ef0bd-0f39-446f-8cfe-e5b623d05cdc tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:01.207369 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-723ef0bd-0f39-446f-8cfe-e5b623d05cdc tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:01.291492 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-723ef0bd-0f39-446f-8cfe-e5b623d05cdc tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lazy-loading 'services' on Instance uuid 4ab8f789-f8ff-4804-bfcb-3e1d600943b2 {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 17:35:01.365616 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-723ef0bd-0f39-446f-8cfe-e5b623d05cdc tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2/os-volume_attachments/58351ef1-8f0c-4990-9355-38d2e1f1650e" status: 202 len: 0 microversion: 2.1 time: 0.170175 May 28 17:35:01.366266 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 484/985] 10.222.0.33 () {58 vars in 1415 bytes} [Sat May 28 17:35:01 2022] DELETE /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2/os-volume_attachments/58351ef1-8f0c-4990-9355-38d2e1f1650e => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 17:35:01.592078 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3196d49c-704f-41b2-8217-63ce1e7b7636 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:01.592715 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3196d49c-704f-41b2-8217-63ce1e7b7636 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:01.599077 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3196d49c-704f-41b2-8217-63ce1e7b7636 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:01.599555 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3196d49c-704f-41b2-8217-63ce1e7b7636 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:01.600309 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3196d49c-704f-41b2-8217-63ce1e7b7636 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:01.600736 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3196d49c-704f-41b2-8217-63ce1e7b7636 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:01.733035 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-3196d49c-704f-41b2-8217-63ce1e7b7636 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:01.741583 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-3196d49c-704f-41b2-8217-63ce1e7b7636 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:01.743068 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-3196d49c-704f-41b2-8217-63ce1e7b7636 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:01.744528 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3196d49c-704f-41b2-8217-63ce1e7b7636 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1730 microversion: 2.20 time: 0.156415 May 28 17:35:01.745075 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 502/986] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:35:01 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:35:02.763953 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3776496f-cdf4-40d0-a474-9bcff118ecc3 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:02.764747 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3776496f-cdf4-40d0-a474-9bcff118ecc3 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:02.772824 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3776496f-cdf4-40d0-a474-9bcff118ecc3 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:02.773353 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3776496f-cdf4-40d0-a474-9bcff118ecc3 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:02.774689 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3776496f-cdf4-40d0-a474-9bcff118ecc3 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:02.775231 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3776496f-cdf4-40d0-a474-9bcff118ecc3 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:02.981078 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3776496f-cdf4-40d0-a474-9bcff118ecc3 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:02.990840 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3776496f-cdf4-40d0-a474-9bcff118ecc3 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:02.993774 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3776496f-cdf4-40d0-a474-9bcff118ecc3 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:02.995382 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3776496f-cdf4-40d0-a474-9bcff118ecc3 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1730 microversion: 2.20 time: 0.236133 May 28 17:35:02.996703 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 485/987] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:35:02 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1730 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:35:03.376516 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e03e013b-dce8-40e6-a865-b773a997918e tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:03.377121 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e03e013b-dce8-40e6-a865-b773a997918e tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 6863e51f-850f-4d83-a5ea-34408f176184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:03.384355 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e03e013b-dce8-40e6-a865-b773a997918e tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:03.384909 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e03e013b-dce8-40e6-a865-b773a997918e tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:03.386095 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e03e013b-dce8-40e6-a865-b773a997918e tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:03.386543 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e03e013b-dce8-40e6-a865-b773a997918e tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:03.410643 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e03e013b-dce8-40e6-a865-b773a997918e tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184/ips" status: 200 len: 147 microversion: 2.1 time: 0.038273 May 28 17:35:03.412172 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 503/988] 10.222.0.33 () {58 vars in 1247 bytes} [Sat May 28 17:35:03 2022] GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:35:03.544448 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3c4f6752-8219-4a13-b179-6b1bce1531ca tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:03.545301 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3c4f6752-8219-4a13-b179-6b1bce1531ca tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:03.551209 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3c4f6752-8219-4a13-b179-6b1bce1531ca tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:03.552617 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3c4f6752-8219-4a13-b179-6b1bce1531ca tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:03.553512 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3c4f6752-8219-4a13-b179-6b1bce1531ca tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:03.554055 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3c4f6752-8219-4a13-b179-6b1bce1531ca tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:03.591937 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3c4f6752-8219-4a13-b179-6b1bce1531ca tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2/os-volume_attachments/c211d40b-ef43-4a99-ae5f-f824a82cae3b" status: 200 len: 194 microversion: 2.1 time: 0.051217 May 28 17:35:03.592738 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 486/989] 10.222.0.33 () {58 vars in 1412 bytes} [Sat May 28 17:35:03 2022] GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2/os-volume_attachments/c211d40b-ef43-4a99-ae5f-f824a82cae3b => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:35:03.603727 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-cfcff981-ad9a-480b-bb7f-76340cd1d617 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:03.604290 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-cfcff981-ad9a-480b-bb7f-76340cd1d617 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:03.615373 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cfcff981-ad9a-480b-bb7f-76340cd1d617 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:03.615904 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cfcff981-ad9a-480b-bb7f-76340cd1d617 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:03.616889 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cfcff981-ad9a-480b-bb7f-76340cd1d617 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:03.617412 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cfcff981-ad9a-480b-bb7f-76340cd1d617 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:03.620255 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:35:03.765700 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-cfcff981-ad9a-480b-bb7f-76340cd1d617 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lazy-loading 'services' on Instance uuid 4ab8f789-f8ff-4804-bfcb-3e1d600943b2 {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 17:35:03.858183 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-cfcff981-ad9a-480b-bb7f-76340cd1d617 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2/os-volume_attachments/c211d40b-ef43-4a99-ae5f-f824a82cae3b" status: 202 len: 0 microversion: 2.1 time: 0.258210 May 28 17:35:03.859560 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 504/990] 10.222.0.33 () {58 vars in 1415 bytes} [Sat May 28 17:35:03 2022] DELETE /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2/os-volume_attachments/c211d40b-ef43-4a99-ae5f-f824a82cae3b => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 17:35:04.015702 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-fe65f020-2e99-4816-8e43-114ca46a340d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:04.016421 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-fe65f020-2e99-4816-8e43-114ca46a340d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:04.023372 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fe65f020-2e99-4816-8e43-114ca46a340d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:04.023875 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fe65f020-2e99-4816-8e43-114ca46a340d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:04.024898 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fe65f020-2e99-4816-8e43-114ca46a340d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:04.025362 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fe65f020-2e99-4816-8e43-114ca46a340d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:04.166385 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-fe65f020-2e99-4816-8e43-114ca46a340d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:04.178535 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-fe65f020-2e99-4816-8e43-114ca46a340d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:04.180340 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-fe65f020-2e99-4816-8e43-114ca46a340d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:04.181721 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-fe65f020-2e99-4816-8e43-114ca46a340d tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1730 microversion: 2.20 time: 0.170401 May 28 17:35:04.182291 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 487/991] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:35:04 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:35:04.910484 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6f52f7c1-7ed7-4673-8e9b-97c0e355e964 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "889cc987-3bbb-4b93-903c-7dcfb2541d55"}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:35:04.911883 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6f52f7c1-7ed7-4673-8e9b-97c0e355e964 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 6863e51f-850f-4d83-a5ea-34408f176184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:04.919022 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6f52f7c1-7ed7-4673-8e9b-97c0e355e964 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:04.919577 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6f52f7c1-7ed7-4673-8e9b-97c0e355e964 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:04.920426 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6f52f7c1-7ed7-4673-8e9b-97c0e355e964 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:04.920934 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6f52f7c1-7ed7-4673-8e9b-97c0e355e964 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:05.200756 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f4ec49bb-4009-4ace-967d-07073c8f77ab tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:05.201539 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f4ec49bb-4009-4ace-967d-07073c8f77ab tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:05.209276 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f4ec49bb-4009-4ace-967d-07073c8f77ab tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:05.210389 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f4ec49bb-4009-4ace-967d-07073c8f77ab tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:05.211600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f4ec49bb-4009-4ace-967d-07073c8f77ab tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:05.212469 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f4ec49bb-4009-4ace-967d-07073c8f77ab tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:05.367392 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f4ec49bb-4009-4ace-967d-07073c8f77ab tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:05.375694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f4ec49bb-4009-4ace-967d-07073c8f77ab tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:05.378364 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f4ec49bb-4009-4ace-967d-07073c8f77ab tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:05.379996 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f4ec49bb-4009-4ace-967d-07073c8f77ab tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1730 microversion: 2.20 time: 0.183299 May 28 17:35:05.381164 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 488/992] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:35:05 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:35:06.398464 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-05dd691c-a4a8-4c9a-b94d-edd1edbe2476 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:06.399183 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-05dd691c-a4a8-4c9a-b94d-edd1edbe2476 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:06.405726 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-05dd691c-a4a8-4c9a-b94d-edd1edbe2476 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:06.406189 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-05dd691c-a4a8-4c9a-b94d-edd1edbe2476 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:06.406962 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-05dd691c-a4a8-4c9a-b94d-edd1edbe2476 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:06.407435 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-05dd691c-a4a8-4c9a-b94d-edd1edbe2476 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:06.546930 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-05dd691c-a4a8-4c9a-b94d-edd1edbe2476 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:06.556307 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-05dd691c-a4a8-4c9a-b94d-edd1edbe2476 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:06.557895 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-05dd691c-a4a8-4c9a-b94d-edd1edbe2476 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:06.559083 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-05dd691c-a4a8-4c9a-b94d-edd1edbe2476 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1730 microversion: 2.20 time: 0.164853 May 28 17:35:06.559894 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 489/993] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:35:06 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:35:07.577022 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a9bd4c9f-9c4a-44eb-af24-a68601cdab53 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:07.577708 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a9bd4c9f-9c4a-44eb-af24-a68601cdab53 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:07.584548 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a9bd4c9f-9c4a-44eb-af24-a68601cdab53 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:07.585000 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a9bd4c9f-9c4a-44eb-af24-a68601cdab53 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:07.585777 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a9bd4c9f-9c4a-44eb-af24-a68601cdab53 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:07.586301 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a9bd4c9f-9c4a-44eb-af24-a68601cdab53 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:07.727751 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a9bd4c9f-9c4a-44eb-af24-a68601cdab53 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:07.737509 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a9bd4c9f-9c4a-44eb-af24-a68601cdab53 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:07.739006 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a9bd4c9f-9c4a-44eb-af24-a68601cdab53 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:07.741387 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a9bd4c9f-9c4a-44eb-af24-a68601cdab53 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1730 microversion: 2.20 time: 0.168286 May 28 17:35:07.742061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 490/994] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:35:07 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:35:08.760541 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-414983ca-f79f-4eb3-89ea-7dd990a22ca8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:08.761247 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-414983ca-f79f-4eb3-89ea-7dd990a22ca8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:08.768110 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-414983ca-f79f-4eb3-89ea-7dd990a22ca8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:08.768558 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-414983ca-f79f-4eb3-89ea-7dd990a22ca8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:08.769330 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-414983ca-f79f-4eb3-89ea-7dd990a22ca8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:08.769801 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-414983ca-f79f-4eb3-89ea-7dd990a22ca8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:08.911773 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-414983ca-f79f-4eb3-89ea-7dd990a22ca8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:08.920226 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-414983ca-f79f-4eb3-89ea-7dd990a22ca8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:08.921723 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-414983ca-f79f-4eb3-89ea-7dd990a22ca8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:08.922888 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-414983ca-f79f-4eb3-89ea-7dd990a22ca8 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1730 microversion: 2.20 time: 0.166497 May 28 17:35:08.923530 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 491/995] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:35:08 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:35:09.941635 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-bd1e6915-912d-46c6-add0-47f06e541d3f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:09.942303 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-bd1e6915-912d-46c6-add0-47f06e541d3f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:09.948948 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bd1e6915-912d-46c6-add0-47f06e541d3f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:09.949398 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bd1e6915-912d-46c6-add0-47f06e541d3f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:09.950185 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bd1e6915-912d-46c6-add0-47f06e541d3f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:09.950625 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bd1e6915-912d-46c6-add0-47f06e541d3f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:10.086858 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bd1e6915-912d-46c6-add0-47f06e541d3f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:10.089378 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:35:10.096490 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bd1e6915-912d-46c6-add0-47f06e541d3f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:10.098142 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bd1e6915-912d-46c6-add0-47f06e541d3f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:10.099508 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-bd1e6915-912d-46c6-add0-47f06e541d3f tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1730 microversion: 2.20 time: 0.161809 May 28 17:35:10.104303 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 492/996] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:35:09 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:35:11.118679 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-09c0af07-507b-4a6d-b5d5-a6f706d477f9 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:11.120084 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-09c0af07-507b-4a6d-b5d5-a6f706d477f9 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:11.128147 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-09c0af07-507b-4a6d-b5d5-a6f706d477f9 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:11.128603 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-09c0af07-507b-4a6d-b5d5-a6f706d477f9 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:11.129382 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-09c0af07-507b-4a6d-b5d5-a6f706d477f9 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:11.129829 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-09c0af07-507b-4a6d-b5d5-a6f706d477f9 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:11.269856 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-09c0af07-507b-4a6d-b5d5-a6f706d477f9 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:11.280239 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-09c0af07-507b-4a6d-b5d5-a6f706d477f9 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:11.281776 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-09c0af07-507b-4a6d-b5d5-a6f706d477f9 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:11.283113 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-09c0af07-507b-4a6d-b5d5-a6f706d477f9 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1730 microversion: 2.20 time: 0.169169 May 28 17:35:11.284192 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 493/997] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:35:11 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:35:12.304285 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-886599e1-42d4-4f8b-83ca-77c34086536e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:12.304969 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-886599e1-42d4-4f8b-83ca-77c34086536e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:12.311589 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-886599e1-42d4-4f8b-83ca-77c34086536e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:12.312042 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-886599e1-42d4-4f8b-83ca-77c34086536e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:12.312794 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-886599e1-42d4-4f8b-83ca-77c34086536e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:12.313226 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-886599e1-42d4-4f8b-83ca-77c34086536e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:12.449884 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-886599e1-42d4-4f8b-83ca-77c34086536e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:12.457877 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-886599e1-42d4-4f8b-83ca-77c34086536e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:12.459512 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-886599e1-42d4-4f8b-83ca-77c34086536e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:12.460669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-886599e1-42d4-4f8b-83ca-77c34086536e tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1730 microversion: 2.20 time: 0.161283 May 28 17:35:12.461225 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 494/998] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:35:12 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:35:13.478466 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8fab4db7-af7d-4617-b274-3c22a190a043 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:13.479094 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8fab4db7-af7d-4617-b274-3c22a190a043 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:13.481353 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=48 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:35:13.486594 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8fab4db7-af7d-4617-b274-3c22a190a043 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:13.487045 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8fab4db7-af7d-4617-b274-3c22a190a043 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:13.487834 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8fab4db7-af7d-4617-b274-3c22a190a043 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:13.488277 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8fab4db7-af7d-4617-b274-3c22a190a043 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:13.616572 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8fab4db7-af7d-4617-b274-3c22a190a043 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:13.624401 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8fab4db7-af7d-4617-b274-3c22a190a043 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:13.625903 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8fab4db7-af7d-4617-b274-3c22a190a043 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:13.627054 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8fab4db7-af7d-4617-b274-3c22a190a043 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1730 microversion: 2.20 time: 0.153099 May 28 17:35:13.627641 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 495/999] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:35:13 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:35:14.648178 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c3a9cd38-fa57-4d8d-9e0b-d5d44a75abdf tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:14.649357 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c3a9cd38-fa57-4d8d-9e0b-d5d44a75abdf tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:14.656240 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c3a9cd38-fa57-4d8d-9e0b-d5d44a75abdf tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:14.656688 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c3a9cd38-fa57-4d8d-9e0b-d5d44a75abdf tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:14.657454 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c3a9cd38-fa57-4d8d-9e0b-d5d44a75abdf tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:14.657892 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c3a9cd38-fa57-4d8d-9e0b-d5d44a75abdf tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:14.790381 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c3a9cd38-fa57-4d8d-9e0b-d5d44a75abdf tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:14.798275 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c3a9cd38-fa57-4d8d-9e0b-d5d44a75abdf tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:14.799784 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c3a9cd38-fa57-4d8d-9e0b-d5d44a75abdf tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:14.800930 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c3a9cd38-fa57-4d8d-9e0b-d5d44a75abdf tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1730 microversion: 2.20 time: 0.158781 May 28 17:35:14.801479 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 496/1000] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:35:14 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:35:14.916072 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=37 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:35:15.012019 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=14,nova_cell1:INSERT=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:35:15.819329 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c3c24c94-f299-4d1b-a67f-6d8892a37381 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:15.819891 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c3c24c94-f299-4d1b-a67f-6d8892a37381 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:15.826319 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c3c24c94-f299-4d1b-a67f-6d8892a37381 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:15.826760 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c3c24c94-f299-4d1b-a67f-6d8892a37381 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:15.827541 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c3c24c94-f299-4d1b-a67f-6d8892a37381 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:15.827973 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c3c24c94-f299-4d1b-a67f-6d8892a37381 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:15.955652 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c3c24c94-f299-4d1b-a67f-6d8892a37381 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:15.972204 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c3c24c94-f299-4d1b-a67f-6d8892a37381 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:15.974311 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c3c24c94-f299-4d1b-a67f-6d8892a37381 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:15.975622 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c3c24c94-f299-4d1b-a67f-6d8892a37381 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1730 microversion: 2.20 time: 0.160784 May 28 17:35:15.976176 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 497/1001] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:35:15 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:35:16.183068 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6f52f7c1-7ed7-4673-8e9b-97c0e355e964 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "POST /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.276975 May 28 17:35:16.184523 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 505/1002] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 17:35:04 2022] POST /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184/os-volume_attachments => generated 194 bytes in 11279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:35:16.994795 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-bf982376-3835-4666-a937-fba84fc5ac4c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:16.995463 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-bf982376-3835-4666-a937-fba84fc5ac4c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:17.002133 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bf982376-3835-4666-a937-fba84fc5ac4c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:17.002576 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bf982376-3835-4666-a937-fba84fc5ac4c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:17.003357 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bf982376-3835-4666-a937-fba84fc5ac4c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:17.003789 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bf982376-3835-4666-a937-fba84fc5ac4c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:17.131999 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bf982376-3835-4666-a937-fba84fc5ac4c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:17.139708 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bf982376-3835-4666-a937-fba84fc5ac4c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:17.141200 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bf982376-3835-4666-a937-fba84fc5ac4c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:17.142345 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-bf982376-3835-4666-a937-fba84fc5ac4c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1730 microversion: 2.20 time: 0.151616 May 28 17:35:17.142919 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 498/1003] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:35:16 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:35:18.162417 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3c2018d5-192b-4d63-bfd4-7221bbfe0428 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:18.163106 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3c2018d5-192b-4d63-bfd4-7221bbfe0428 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:18.169293 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3c2018d5-192b-4d63-bfd4-7221bbfe0428 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:18.169734 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3c2018d5-192b-4d63-bfd4-7221bbfe0428 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:18.170487 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3c2018d5-192b-4d63-bfd4-7221bbfe0428 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:18.170914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3c2018d5-192b-4d63-bfd4-7221bbfe0428 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:18.300211 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-3c2018d5-192b-4d63-bfd4-7221bbfe0428 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:18.312150 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-3c2018d5-192b-4d63-bfd4-7221bbfe0428 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:18.313759 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-3c2018d5-192b-4d63-bfd4-7221bbfe0428 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:18.314926 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3c2018d5-192b-4d63-bfd4-7221bbfe0428 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1730 microversion: 2.20 time: 0.157974 May 28 17:35:18.315701 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 506/1004] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:35:18 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:35:19.335193 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1ea96729-b24b-4d6c-a43a-55aaf31ae3dd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:19.336420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1ea96729-b24b-4d6c-a43a-55aaf31ae3dd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:19.342653 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1ea96729-b24b-4d6c-a43a-55aaf31ae3dd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:19.343280 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1ea96729-b24b-4d6c-a43a-55aaf31ae3dd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:19.344213 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1ea96729-b24b-4d6c-a43a-55aaf31ae3dd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:19.344802 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1ea96729-b24b-4d6c-a43a-55aaf31ae3dd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:19.487883 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1ea96729-b24b-4d6c-a43a-55aaf31ae3dd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:19.497214 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1ea96729-b24b-4d6c-a43a-55aaf31ae3dd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:19.498745 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1ea96729-b24b-4d6c-a43a-55aaf31ae3dd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:19.499959 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1ea96729-b24b-4d6c-a43a-55aaf31ae3dd tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1730 microversion: 2.20 time: 0.169750 May 28 17:35:19.500521 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 499/1005] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:35:19 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:35:19.836377 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-67c9e40f-ddaa-42bf-aca1-b1ab9d5e24cd tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:19.837948 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-67c9e40f-ddaa-42bf-aca1-b1ab9d5e24cd tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:19.844468 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-67c9e40f-ddaa-42bf-aca1-b1ab9d5e24cd tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:19.844917 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-67c9e40f-ddaa-42bf-aca1-b1ab9d5e24cd tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:19.845683 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-67c9e40f-ddaa-42bf-aca1-b1ab9d5e24cd tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:19.846295 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-67c9e40f-ddaa-42bf-aca1-b1ab9d5e24cd tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:19.875128 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-67c9e40f-ddaa-42bf-aca1-b1ab9d5e24cd tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043374 May 28 17:35:19.875710 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 507/1006] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 17:35:19 2022] GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 17:35:19.986378 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-75f79d45-b90b-4a9c-b76d-94848c98d237 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:19.987300 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-75f79d45-b90b-4a9c-b76d-94848c98d237 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:19.993325 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-75f79d45-b90b-4a9c-b76d-94848c98d237 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:19.993772 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-75f79d45-b90b-4a9c-b76d-94848c98d237 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:19.994525 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-75f79d45-b90b-4a9c-b76d-94848c98d237 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:19.994956 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-75f79d45-b90b-4a9c-b76d-94848c98d237 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:20.023744 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-75f79d45-b90b-4a9c-b76d-94848c98d237 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041098 May 28 17:35:20.024201 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 500/1007] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 17:35:19 2022] GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 17:35:20.080212 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-10c54c2a-42af-47ce-bd00-d57095018c1f tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:20.080715 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-10c54c2a-42af-47ce-bd00-d57095018c1f tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:20.087531 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-10c54c2a-42af-47ce-bd00-d57095018c1f tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:20.087990 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-10c54c2a-42af-47ce-bd00-d57095018c1f tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:20.088754 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-10c54c2a-42af-47ce-bd00-d57095018c1f tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:20.089194 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-10c54c2a-42af-47ce-bd00-d57095018c1f tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:20.112786 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-10c54c2a-42af-47ce-bd00-d57095018c1f tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Going to try to terminate instance {{(pid=117604) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 17:35:20.190325 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-10c54c2a-42af-47ce-bd00-d57095018c1f tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2" status: 204 len: 0 microversion: 2.1 time: 0.113027 May 28 17:35:20.193110 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 508/1008] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 17:35:20 2022] DELETE /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 17:35:20.201837 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-304c3414-7ca3-4740-ac28-95a3150da57e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:20.202452 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-304c3414-7ca3-4740-ac28-95a3150da57e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:20.210307 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-304c3414-7ca3-4740-ac28-95a3150da57e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:20.210761 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-304c3414-7ca3-4740-ac28-95a3150da57e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:20.211917 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-304c3414-7ca3-4740-ac28-95a3150da57e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:20.212681 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-304c3414-7ca3-4740-ac28-95a3150da57e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:20.345009 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-304c3414-7ca3-4740-ac28-95a3150da57e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:20.352429 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-304c3414-7ca3-4740-ac28-95a3150da57e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2" status: 200 len: 1672 microversion: 2.1 time: 0.154408 May 28 17:35:20.352987 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 501/1009] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:35:20 2022] GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:35:20.520494 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ead33261-f2ab-4453-bc40-897ca7adc8f0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:20.521334 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ead33261-f2ab-4453-bc40-897ca7adc8f0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:20.527757 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ead33261-f2ab-4453-bc40-897ca7adc8f0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:20.528204 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ead33261-f2ab-4453-bc40-897ca7adc8f0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:20.528959 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ead33261-f2ab-4453-bc40-897ca7adc8f0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:20.529390 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ead33261-f2ab-4453-bc40-897ca7adc8f0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:20.658656 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ead33261-f2ab-4453-bc40-897ca7adc8f0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:20.667057 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ead33261-f2ab-4453-bc40-897ca7adc8f0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:20.668580 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ead33261-f2ab-4453-bc40-897ca7adc8f0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:20.669731 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ead33261-f2ab-4453-bc40-897ca7adc8f0 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1730 microversion: 2.20 time: 0.153525 May 28 17:35:20.670291 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 509/1010] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:35:20 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:35:21.218516 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-9ba2c99c-2004-427d-90bc-86d791eda7f8 req-62a5e7ef-cc08-4d18-9882-7cc9aa344dba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27322ac4-8704-4f1a-b431-e5c4ad7d77ad", "name": "network-vif-plugged", "status": "completed", "tag": "e951fe87-910c-4495-88e9-a876c275be25"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:35:21.229758 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-9ba2c99c-2004-427d-90bc-86d791eda7f8 req-62a5e7ef-cc08-4d18-9882-7cc9aa344dba service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:21.230245 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-9ba2c99c-2004-427d-90bc-86d791eda7f8 req-62a5e7ef-cc08-4d18-9882-7cc9aa344dba service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:21.242025 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-9ba2c99c-2004-427d-90bc-86d791eda7f8 req-62a5e7ef-cc08-4d18-9882-7cc9aa344dba service nova] Creating event network-vif-plugged:e951fe87-910c-4495-88e9-a876c275be25 for instance 27322ac4-8704-4f1a-b431-e5c4ad7d77ad on hv-cinder-84372 May 28 17:35:21.246974 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-9ba2c99c-2004-427d-90bc-86d791eda7f8 req-62a5e7ef-cc08-4d18-9882-7cc9aa344dba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032106 May 28 17:35:21.247590 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 502/1011] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:35:21.369056 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d58a7c54-fe36-4db1-97f2-1f287d4f6132 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:21.369671 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d58a7c54-fe36-4db1-97f2-1f287d4f6132 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:21.375665 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d58a7c54-fe36-4db1-97f2-1f287d4f6132 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:21.376118 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d58a7c54-fe36-4db1-97f2-1f287d4f6132 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:21.376877 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d58a7c54-fe36-4db1-97f2-1f287d4f6132 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:21.377318 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d58a7c54-fe36-4db1-97f2-1f287d4f6132 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:21.509610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d58a7c54-fe36-4db1-97f2-1f287d4f6132 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:21.516980 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d58a7c54-fe36-4db1-97f2-1f287d4f6132 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2" status: 200 len: 1672 microversion: 2.1 time: 0.151812 May 28 17:35:21.517762 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 510/1012] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:35:21 2022] GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:35:21.689059 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d9284b0c-b7b0-4fdd-96f6-7153158c2c56 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:21.689747 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d9284b0c-b7b0-4fdd-96f6-7153158c2c56 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:21.697170 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d9284b0c-b7b0-4fdd-96f6-7153158c2c56 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:21.697611 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d9284b0c-b7b0-4fdd-96f6-7153158c2c56 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:21.698373 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d9284b0c-b7b0-4fdd-96f6-7153158c2c56 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:21.698802 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d9284b0c-b7b0-4fdd-96f6-7153158c2c56 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:21.833312 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d9284b0c-b7b0-4fdd-96f6-7153158c2c56 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:21.841305 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d9284b0c-b7b0-4fdd-96f6-7153158c2c56 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:21.842809 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d9284b0c-b7b0-4fdd-96f6-7153158c2c56 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:21.844024 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d9284b0c-b7b0-4fdd-96f6-7153158c2c56 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1730 microversion: 2.20 time: 0.159184 May 28 17:35:21.844583 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 503/1013] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:35:21 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:35:22.534090 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-003a5a82-be67-4f4e-a444-de9a831c0bf7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:22.534909 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-003a5a82-be67-4f4e-a444-de9a831c0bf7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:22.541764 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-003a5a82-be67-4f4e-a444-de9a831c0bf7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:22.542246 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-003a5a82-be67-4f4e-a444-de9a831c0bf7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:22.543156 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-003a5a82-be67-4f4e-a444-de9a831c0bf7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:22.543636 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-003a5a82-be67-4f4e-a444-de9a831c0bf7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:22.673629 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-003a5a82-be67-4f4e-a444-de9a831c0bf7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:22.681733 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-003a5a82-be67-4f4e-a444-de9a831c0bf7 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2" status: 200 len: 1672 microversion: 2.1 time: 0.151647 May 28 17:35:22.682292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 511/1014] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:35:22 2022] GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:35:22.861991 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3950502e-8545-4b3f-a228-bcccd40b22fb tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:22.862549 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3950502e-8545-4b3f-a228-bcccd40b22fb tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:22.869691 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3950502e-8545-4b3f-a228-bcccd40b22fb tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:22.870147 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3950502e-8545-4b3f-a228-bcccd40b22fb tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:22.870909 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3950502e-8545-4b3f-a228-bcccd40b22fb tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:22.871357 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3950502e-8545-4b3f-a228-bcccd40b22fb tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:23.001227 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3950502e-8545-4b3f-a228-bcccd40b22fb tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:23.009347 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3950502e-8545-4b3f-a228-bcccd40b22fb tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:23.010838 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3950502e-8545-4b3f-a228-bcccd40b22fb tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:23.012021 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3950502e-8545-4b3f-a228-bcccd40b22fb tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1730 microversion: 2.20 time: 0.154017 May 28 17:35:23.012581 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 504/1015] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:35:22 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:35:23.698482 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-cb845aaf-b27f-4464-b3fa-b1cfee825a3a tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:23.699092 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-cb845aaf-b27f-4464-b3fa-b1cfee825a3a tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:23.705531 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cb845aaf-b27f-4464-b3fa-b1cfee825a3a tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:23.705976 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cb845aaf-b27f-4464-b3fa-b1cfee825a3a tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:23.706729 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cb845aaf-b27f-4464-b3fa-b1cfee825a3a tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:23.707161 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-cb845aaf-b27f-4464-b3fa-b1cfee825a3a tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:23.842782 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-cb845aaf-b27f-4464-b3fa-b1cfee825a3a tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:23.851489 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-cb845aaf-b27f-4464-b3fa-b1cfee825a3a tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2" status: 200 len: 1672 microversion: 2.1 time: 0.156653 May 28 17:35:23.852080 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 512/1016] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:35:23 2022] GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:35:24.029515 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b95de052-e0e9-4df1-95ad-85a9a6493cbc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:24.030240 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-b95de052-e0e9-4df1-95ad-85a9a6493cbc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:24.037072 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b95de052-e0e9-4df1-95ad-85a9a6493cbc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:24.037522 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b95de052-e0e9-4df1-95ad-85a9a6493cbc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:24.038359 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b95de052-e0e9-4df1-95ad-85a9a6493cbc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:24.038724 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-b95de052-e0e9-4df1-95ad-85a9a6493cbc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:24.260385 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b95de052-e0e9-4df1-95ad-85a9a6493cbc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:24.278273 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b95de052-e0e9-4df1-95ad-85a9a6493cbc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:24.280087 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b95de052-e0e9-4df1-95ad-85a9a6493cbc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:24.281313 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b95de052-e0e9-4df1-95ad-85a9a6493cbc tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1730 microversion: 2.20 time: 0.255762 May 28 17:35:24.288776 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 505/1017] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:35:24 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1730 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:35:24.313899 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-d9277e96-7483-458a-9917-1aaa75ddb40f req-1dad1e84-0440-44ba-adfc-73014201b968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ab8f789-f8ff-4804-bfcb-3e1d600943b2", "name": "network-vif-deleted", "tag": "ec8a6a71-b7c9-479a-9c50-6bdafed86a1d"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:35:24.327740 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-d9277e96-7483-458a-9917-1aaa75ddb40f req-1dad1e84-0440-44ba-adfc-73014201b968 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:24.328194 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-d9277e96-7483-458a-9917-1aaa75ddb40f req-1dad1e84-0440-44ba-adfc-73014201b968 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:24.344233 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-d9277e96-7483-458a-9917-1aaa75ddb40f req-1dad1e84-0440-44ba-adfc-73014201b968 service nova] Creating event network-vif-deleted:ec8a6a71-b7c9-479a-9c50-6bdafed86a1d for instance 4ab8f789-f8ff-4804-bfcb-3e1d600943b2 on hv-cinder-84372 May 28 17:35:24.359647 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-d9277e96-7483-458a-9917-1aaa75ddb40f req-1dad1e84-0440-44ba-adfc-73014201b968 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041869 May 28 17:35:24.364768 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 513/1018] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:35:24.869681 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c9196f01-1410-41d4-a2fe-0ba6e2f9e820 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:24.870441 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c9196f01-1410-41d4-a2fe-0ba6e2f9e820 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:24.876496 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c9196f01-1410-41d4-a2fe-0ba6e2f9e820 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:24.876954 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c9196f01-1410-41d4-a2fe-0ba6e2f9e820 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:24.877713 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c9196f01-1410-41d4-a2fe-0ba6e2f9e820 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:24.878152 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c9196f01-1410-41d4-a2fe-0ba6e2f9e820 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:24.909111 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c9196f01-1410-41d4-a2fe-0ba6e2f9e820 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:24.909561 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c9196f01-1410-41d4-a2fe-0ba6e2f9e820 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:24.910008 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-c9196f01-1410-41d4-a2fe-0ba6e2f9e820 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lazy-loading 'fault' on Instance uuid 4ab8f789-f8ff-4804-bfcb-3e1d600943b2 {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 17:35:24.954609 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c9196f01-1410-41d4-a2fe-0ba6e2f9e820 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcc62869ac34381a2327be46511137b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b378551d1c467e911cf01274c97d85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:24.965569 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c9196f01-1410-41d4-a2fe-0ba6e2f9e820 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2" status: 200 len: 1326 microversion: 2.1 time: 0.099626 May 28 17:35:24.966147 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 506/1019] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:35:24 2022] GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2 => generated 1326 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:35:25.301991 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-58a76a21-a2a8-4bff-8633-b543915d1257 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:25.303171 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-58a76a21-a2a8-4bff-8633-b543915d1257 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:25.309437 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-58a76a21-a2a8-4bff-8633-b543915d1257 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:25.309978 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-58a76a21-a2a8-4bff-8633-b543915d1257 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:25.310852 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-58a76a21-a2a8-4bff-8633-b543915d1257 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:25.311297 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-58a76a21-a2a8-4bff-8633-b543915d1257 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:25.448413 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-58a76a21-a2a8-4bff-8633-b543915d1257 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:25.456795 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-58a76a21-a2a8-4bff-8633-b543915d1257 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:25.458968 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-58a76a21-a2a8-4bff-8633-b543915d1257 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:25.460373 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-58a76a21-a2a8-4bff-8633-b543915d1257 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1717 microversion: 2.20 time: 0.163656 May 28 17:35:25.460939 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 514/1020] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:35:25 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1717 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:35:25.983275 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ff1b9216-f8d2-48f5-aa05-177f634df18d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:25.983830 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ff1b9216-f8d2-48f5-aa05-177f634df18d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:25.990642 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ff1b9216-f8d2-48f5-aa05-177f634df18d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:25.991090 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ff1b9216-f8d2-48f5-aa05-177f634df18d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:25.991871 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ff1b9216-f8d2-48f5-aa05-177f634df18d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:25.992559 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ff1b9216-f8d2-48f5-aa05-177f634df18d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:26.009135 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-ff1b9216-f8d2-48f5-aa05-177f634df18d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] HTTP exception thrown: Instance 4ab8f789-f8ff-4804-bfcb-3e1d600943b2 could not be found. May 28 17:35:26.010790 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ff1b9216-f8d2-48f5-aa05-177f634df18d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Request method failure captured: May 28 17:35:26.010790 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2 HTTP/1.1 May 28 17:35:26.010790 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept: application/json May 28 17:35:26.010790 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity May 28 17:35:26.010790 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Connection: close May 28 17:35:26.010790 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Length: 0 May 28 17:35:26.010790 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Type: application/json May 28 17:35:26.010790 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 May 28 17:35:26.010790 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None May 28 17:35:26.010790 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 May 28 17:35:26.010790 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABiklsQwaALxIpoi-IQH5ulhomUzFtt0EHGvqFk34aslFHgcc8sGBZCHK9ucNqV3kceChC4qsoegwSUz42jW60ch9icnM2zXQM0e-3SG5KJN4XJR0zFETmt9esiUnyT2CHSaBoujBd1aDkt7nYWHIo-UDHEDTjlbPZknmx1CMAICvmILgM May 28 17:35:26.010790 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Id: None May 28 17:35:26.010790 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Name: None May 28 17:35:26.010790 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed May 28 17:35:26.010790 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True May 28 17:35:26.010790 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default May 28 17:35:26.010790 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default May 28 17:35:26.010790 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Id: 90b378551d1c467e911cf01274c97d85 May 28 17:35:26.010790 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeTestJSON-1064743775 May 28 17:35:26.010790 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Role: reader,member May 28 17:35:26.010790 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Roles: reader,member May 28 17:35:26.012566 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90b378551d1c467e911cf01274c97d85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90b378551d1c467e911cf01274c97d85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/90b378551d1c467e911cf01274c97d85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_90b378551d1c467e911cf01274c97d85", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:35:26.012566 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeTestJSON-1064743775 May 28 17:35:26.012566 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 90b378551d1c467e911cf01274c97d85 May 28 17:35:26.012566 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1064743775 May 28 17:35:26.012566 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeTestJSON-1064743775-project May 28 17:35:26.012566 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default May 28 17:35:26.012566 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default May 28 17:35:26.012566 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Id: 7fcc62869ac34381a2327be46511137b May 28 17:35:26.012566 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeTestJSON-1064743775-project May 28 17:35:26.012566 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: method: > May 28 17:35:26.012566 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: exception: Instance 4ab8f789-f8ff-4804-bfcb-3e1d600943b2 could not be found. May 28 17:35:26.012566 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: action_args: {'id': '4ab8f789-f8ff-4804-bfcb-3e1d600943b2'} May 28 17:35:26.013664 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:35:26.013664 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:35:26.013664 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:35:26.013664 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:35:26.013664 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:35:26.013664 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:35:26.013664 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:35:26.013664 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:35:26.013664 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:35:26.013664 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:35:26.013664 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ab8f789-f8ff-4804-bfcb-3e1d600943b2 could not be found. May 28 17:35:26.013664 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:35:26.013664 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:35:26.013664 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:35:26.013664 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:35:26.013664 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:35:26.013664 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:35:26.013664 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:35:26.013664 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:35:26.013664 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:35:26.015219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:35:26.015219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:35:26.015219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:35:26.015219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:35:26.015219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:35:26.015219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:35:26.015219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:35:26.015219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ab8f789-f8ff-4804-bfcb-3e1d600943b2 could not be found. May 28 17:35:26.015219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:35:26.015219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:35:26.015219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:35:26.015219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:35:26.015219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:35:26.015219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:35:26.015219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:35:26.015219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:35:26.015219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ab8f789-f8ff-4804-bfcb-3e1d600943b2 could not be found. May 28 17:35:26.015219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:35:26.016721 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ff1b9216-f8d2-48f5-aa05-177f634df18d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Returning 404 to user: Instance 4ab8f789-f8ff-4804-bfcb-3e1d600943b2 could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:35:26.016721 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ff1b9216-f8d2-48f5-aa05-177f634df18d tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2" status: 404 len: 111 microversion: 2.1 time: 0.032947 May 28 17:35:26.016721 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 507/1021] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:35:25 2022] GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:35:26.022400 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-52b79ed3-a92a-440b-9af2-a71b23cd6458 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '.version_select at 0x7f9eeffb53a0>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:26.039465 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-52b79ed3-a92a-440b-9af2-a71b23cd6458 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-361195865" status: 202 len: 0 microversion: 2.1 time: 0.021657 May 28 17:35:26.040021 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 515/1022] 10.222.0.33 () {58 vars in 1217 bytes} [Sat May 28 17:35:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-361195865 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 17:35:26.869001 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c2415ebf-0a91-4e38-992c-eaf6de263150 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Action: 'create', calling method: .version_select at 0x7f9efc37ddc0>, body: {"keypair": {"name": "tempest-keypair-1084253352", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsKiJ77AaWXl0DpKnprKgDN3eW7KH3W/eo8i0JrukrNsprDV40RM7I1KYYAn1JRxwoT9L5YT22WU4bxHGhLinA9XwizgYPw+k9mnfZSNUSyEMbcXSBdpK2Vn3pHHtNIGQ=="}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:35:26.883167 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-c2415ebf-0a91-4e38-992c-eaf6de263150 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Getting quotas for project 9525b35792a04dc3a6f109cb39ee9d50. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:35:26.886942 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-c2415ebf-0a91-4e38-992c-eaf6de263150 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Getting quotas for user 7343386004e24474bc0af9126f47182b and project 9525b35792a04dc3a6f109cb39ee9d50. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:35:26.907969 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c2415ebf-0a91-4e38-992c-eaf6de263150 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.042848 May 28 17:35:26.908542 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 508/1023] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 17:35:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:35:28.363556 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c6698873-98c1-41db-a9bf-39d6f872979a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1468177822", "imageRef": "b2aab55c-a793-472a-bc32-81af689ad609", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f73c6d30-f59b-4e03-9c62-138278150c67"}], "security_groups": [{"name": "tempest-securitygroup--915871174"}], "key_name": "tempest-keypair-1084253352", "user_data": "}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:35:28.560559 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.network.neutron [None req-c6698873-98c1-41db-a9bf-39d6f872979a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] validate_networks() for [('f73c6d30-f59b-4e03-9c62-138278150c67', None, None, None, None, None)] {{(pid=117604) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 17:35:28.920381 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a9a69f86-3f51-44cf-9726-dbe9ac726af8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:28.920927 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a9a69f86-3f51-44cf-9726-dbe9ac726af8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:28.924702 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-c6698873-98c1-41db-a9bf-39d6f872979a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Flavor limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 17:35:28.925189 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-c6698873-98c1-41db-a9bf-39d6f872979a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Image limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 17:35:28.925754 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-c6698873-98c1-41db-a9bf-39d6f872979a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Flavor pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 17:35:28.926471 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-c6698873-98c1-41db-a9bf-39d6f872979a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Image pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 17:35:28.926992 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-c6698873-98c1-41db-a9bf-39d6f872979a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 17:35:28.927629 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a9a69f86-3f51-44cf-9726-dbe9ac726af8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:28.928085 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a9a69f86-3f51-44cf-9726-dbe9ac726af8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:28.928854 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a9a69f86-3f51-44cf-9726-dbe9ac726af8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:28.929495 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a9a69f86-3f51-44cf-9726-dbe9ac726af8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:28.936262 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c6698873-98c1-41db-a9bf-39d6f872979a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:28.936743 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c6698873-98c1-41db-a9bf-39d6f872979a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:28.937540 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c6698873-98c1-41db-a9bf-39d6f872979a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:28.937977 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c6698873-98c1-41db-a9bf-39d6f872979a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:28.943046 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-a9a69f86-3f51-44cf-9726-dbe9ac726af8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] HTTP exception thrown: Instance 4ab8f789-f8ff-4804-bfcb-3e1d600943b2 could not be found. May 28 17:35:28.944634 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a9a69f86-3f51-44cf-9726-dbe9ac726af8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Request method failure captured: May 28 17:35:28.944634 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: request: DELETE /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2 HTTP/1.1 May 28 17:35:28.944634 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept: application/json May 28 17:35:28.944634 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity May 28 17:35:28.944634 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Connection: close May 28 17:35:28.944634 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Length: 0 May 28 17:35:28.944634 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Type: application/json May 28 17:35:28.944634 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 May 28 17:35:28.944634 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None May 28 17:35:28.944634 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 May 28 17:35:28.944634 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABiklsQwaALxIpoi-IQH5ulhomUzFtt0EHGvqFk34aslFHgcc8sGBZCHK9ucNqV3kceChC4qsoegwSUz42jW60ch9icnM2zXQM0e-3SG5KJN4XJR0zFETmt9esiUnyT2CHSaBoujBd1aDkt7nYWHIo-UDHEDTjlbPZknmx1CMAICvmILgM May 28 17:35:28.944634 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Id: None May 28 17:35:28.944634 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Name: None May 28 17:35:28.944634 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed May 28 17:35:28.944634 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True May 28 17:35:28.944634 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default May 28 17:35:28.944634 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default May 28 17:35:28.944634 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Id: 90b378551d1c467e911cf01274c97d85 May 28 17:35:28.944634 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeTestJSON-1064743775 May 28 17:35:28.944634 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Role: reader,member May 28 17:35:28.944634 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Roles: reader,member May 28 17:35:28.946105 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90b378551d1c467e911cf01274c97d85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90b378551d1c467e911cf01274c97d85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/90b378551d1c467e911cf01274c97d85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_90b378551d1c467e911cf01274c97d85", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:35:28.946105 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeTestJSON-1064743775 May 28 17:35:28.946105 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 90b378551d1c467e911cf01274c97d85 May 28 17:35:28.946105 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1064743775 May 28 17:35:28.946105 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeTestJSON-1064743775-project May 28 17:35:28.946105 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default May 28 17:35:28.946105 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default May 28 17:35:28.946105 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Id: 7fcc62869ac34381a2327be46511137b May 28 17:35:28.946105 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeTestJSON-1064743775-project May 28 17:35:28.946105 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: method: > May 28 17:35:28.946105 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: exception: Instance 4ab8f789-f8ff-4804-bfcb-3e1d600943b2 could not be found. May 28 17:35:28.946105 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: action_args: {'id': '4ab8f789-f8ff-4804-bfcb-3e1d600943b2'} May 28 17:35:28.947010 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:35:28.947010 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:35:28.947010 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:35:28.947010 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:35:28.947010 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:35:28.947010 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:35:28.947010 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:35:28.947010 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:35:28.947010 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:35:28.947010 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:35:28.947010 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ab8f789-f8ff-4804-bfcb-3e1d600943b2 could not be found. May 28 17:35:28.947010 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:35:28.947010 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:35:28.947010 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:35:28.947010 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:35:28.947010 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:35:28.947010 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:35:28.947010 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:35:28.947010 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:35:28.947010 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:35:28.948562 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:35:28.948562 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 17:35:28.948562 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 17:35:28.948562 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 17:35:28.948562 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 17:35:28.948562 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:35:28.948562 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:35:28.948562 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:35:28.948562 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:35:28.948562 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ab8f789-f8ff-4804-bfcb-3e1d600943b2 could not be found. May 28 17:35:28.948562 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:35:28.948562 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:35:28.948562 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:35:28.948562 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:35:28.948562 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:35:28.948562 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:35:28.948562 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:35:28.948562 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:35:28.948562 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ab8f789-f8ff-4804-bfcb-3e1d600943b2 could not be found. May 28 17:35:28.948562 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:35:28.950333 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a9a69f86-3f51-44cf-9726-dbe9ac726af8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Returning 404 to user: Instance 4ab8f789-f8ff-4804-bfcb-3e1d600943b2 could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:35:28.950333 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a9a69f86-3f51-44cf-9726-dbe9ac726af8 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2" status: 404 len: 111 microversion: 2.1 time: 0.030025 May 28 17:35:28.950333 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 509/1024] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 17:35:28 2022] DELETE /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 17:35:28.954229 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-da46e01b-54ce-48e0-abf6-42a1de97825a tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:28.954837 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-da46e01b-54ce-48e0-abf6-42a1de97825a tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 4ab8f789-f8ff-4804-bfcb-3e1d600943b2] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:28.955260 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-c6698873-98c1-41db-a9bf-39d6f872979a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Getting quotas for project 9525b35792a04dc3a6f109cb39ee9d50. Resources: {'instances', 'cores', 'ram'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:35:28.959954 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-c6698873-98c1-41db-a9bf-39d6f872979a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Getting quotas for user 7343386004e24474bc0af9126f47182b and project 9525b35792a04dc3a6f109cb39ee9d50. Resources: {'instances', 'cores', 'ram'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:35:28.961310 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-da46e01b-54ce-48e0-abf6-42a1de97825a tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:28.961759 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-da46e01b-54ce-48e0-abf6-42a1de97825a tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:28.962522 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-da46e01b-54ce-48e0-abf6-42a1de97825a tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:28.962964 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-da46e01b-54ce-48e0-abf6-42a1de97825a tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:28.970889 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c6698873-98c1-41db-a9bf-39d6f872979a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Going to run 1 instances... {{(pid=117604) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 17:35:28.973661 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c6698873-98c1-41db-a9bf-39d6f872979a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b2aab55c-a793-472a-bc32-81af689ad609',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 17:35:28.978011 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-da46e01b-54ce-48e0-abf6-42a1de97825a tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] HTTP exception thrown: Instance 4ab8f789-f8ff-4804-bfcb-3e1d600943b2 could not be found. May 28 17:35:28.979557 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-da46e01b-54ce-48e0-abf6-42a1de97825a tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Request method failure captured: May 28 17:35:28.979557 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2 HTTP/1.1 May 28 17:35:28.979557 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept: application/json May 28 17:35:28.979557 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity May 28 17:35:28.979557 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Connection: close May 28 17:35:28.979557 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Length: 0 May 28 17:35:28.979557 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Type: application/json May 28 17:35:28.979557 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 May 28 17:35:28.979557 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None May 28 17:35:28.979557 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 May 28 17:35:28.979557 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABiklsQwaALxIpoi-IQH5ulhomUzFtt0EHGvqFk34aslFHgcc8sGBZCHK9ucNqV3kceChC4qsoegwSUz42jW60ch9icnM2zXQM0e-3SG5KJN4XJR0zFETmt9esiUnyT2CHSaBoujBd1aDkt7nYWHIo-UDHEDTjlbPZknmx1CMAICvmILgM May 28 17:35:28.979557 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Id: None May 28 17:35:28.979557 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Name: None May 28 17:35:28.979557 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed May 28 17:35:28.979557 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True May 28 17:35:28.979557 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default May 28 17:35:28.979557 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default May 28 17:35:28.979557 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Id: 90b378551d1c467e911cf01274c97d85 May 28 17:35:28.979557 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeTestJSON-1064743775 May 28 17:35:28.979557 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Role: reader,member May 28 17:35:28.979557 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Roles: reader,member May 28 17:35:28.981108 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90b378551d1c467e911cf01274c97d85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90b378551d1c467e911cf01274c97d85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/90b378551d1c467e911cf01274c97d85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_90b378551d1c467e911cf01274c97d85", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:35:28.981108 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeTestJSON-1064743775 May 28 17:35:28.981108 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 90b378551d1c467e911cf01274c97d85 May 28 17:35:28.981108 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1064743775 May 28 17:35:28.981108 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeTestJSON-1064743775-project May 28 17:35:28.981108 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default May 28 17:35:28.981108 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default May 28 17:35:28.981108 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Id: 7fcc62869ac34381a2327be46511137b May 28 17:35:28.981108 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeTestJSON-1064743775-project May 28 17:35:28.981108 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: method: > May 28 17:35:28.981108 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: exception: Instance 4ab8f789-f8ff-4804-bfcb-3e1d600943b2 could not be found. May 28 17:35:28.981108 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: action_args: {'id': '4ab8f789-f8ff-4804-bfcb-3e1d600943b2'} May 28 17:35:28.981979 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:35:28.981979 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:35:28.981979 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:35:28.981979 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:35:28.981979 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:35:28.981979 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:35:28.981979 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:35:28.981979 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:35:28.981979 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:35:28.981979 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:35:28.981979 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ab8f789-f8ff-4804-bfcb-3e1d600943b2 could not be found. May 28 17:35:28.981979 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:35:28.981979 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:35:28.981979 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:35:28.981979 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:35:28.981979 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:35:28.981979 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:35:28.981979 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:35:28.981979 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:35:28.981979 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:35:28.983412 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:35:28.983412 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:35:28.983412 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:35:28.983412 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:35:28.983412 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:35:28.983412 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:35:28.983412 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:35:28.983412 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ab8f789-f8ff-4804-bfcb-3e1d600943b2 could not be found. May 28 17:35:28.983412 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:35:28.983412 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:35:28.983412 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:35:28.983412 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:35:28.983412 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:35:28.983412 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:35:28.983412 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:35:28.983412 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:35:28.983412 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ab8f789-f8ff-4804-bfcb-3e1d600943b2 could not be found. May 28 17:35:28.983412 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:35:28.984684 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-da46e01b-54ce-48e0-abf6-42a1de97825a tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Returning 404 to user: Instance 4ab8f789-f8ff-4804-bfcb-3e1d600943b2 could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:35:28.984684 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-da46e01b-54ce-48e0-abf6-42a1de97825a tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2" status: 404 len: 111 microversion: 2.1 time: 0.030279 May 28 17:35:28.984684 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 510/1025] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:35:28 2022] GET /compute/v2.1/servers/4ab8f789-f8ff-4804-bfcb-3e1d600943b2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:35:29.021499 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c6698873-98c1-41db-a9bf-39d6f872979a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.662543 May 28 17:35:29.022157 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 516/1026] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 17:35:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 17:35:29.033116 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1ad554a5-49f8-4369-83ad-fd89206e999f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:29.033828 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1ad554a5-49f8-4369-83ad-fd89206e999f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:29.154017 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1ad554a5-49f8-4369-83ad-fd89206e999f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:29.160957 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1ad554a5-49f8-4369-83ad-fd89206e999f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d" status: 200 len: 1242 microversion: 2.1 time: 0.132531 May 28 17:35:29.161531 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 511/1027] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:35:29 2022] GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d => generated 1242 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:35:30.133351 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4b8f016a-fa23-49c7-a70a-063f7914b52e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:30.133996 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-4b8f016a-fa23-49c7-a70a-063f7914b52e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:30.141701 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4b8f016a-fa23-49c7-a70a-063f7914b52e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:30.142158 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4b8f016a-fa23-49c7-a70a-063f7914b52e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:30.142940 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4b8f016a-fa23-49c7-a70a-063f7914b52e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:30.143416 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-4b8f016a-fa23-49c7-a70a-063f7914b52e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:30.157781 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-4b8f016a-fa23-49c7-a70a-063f7914b52e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] HTTP exception thrown: Instance 3b3c1f29-31c9-4f5c-9875-fd1939062512 could not be found. May 28 17:35:30.159504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4b8f016a-fa23-49c7-a70a-063f7914b52e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Request method failure captured: May 28 17:35:30.159504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: DELETE /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 HTTP/1.1 May 28 17:35:30.159504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:35:30.159504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:35:30.159504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:35:30.159504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 0 May 28 17:35:30.159504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:35:30.159504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:35:30.159504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:35:30.159504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:35:30.159504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABiklsQwaALxIpoi-IQH5ulhomUzFtt0EHGvqFk34aslFHgcc8sGBZCHK9ucNqV3kceChC4qsoegwSUz42jW60ch9icnM2zXQM0e-3SG5KJN4XJR0zFETmt9esiUnyT2CHSaBoujBd1aDkt7nYWHIo-UDHEDTjlbPZknmx1CMAICvmILgM May 28 17:35:30.159504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:35:30.159504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:35:30.159504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:35:30.159504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:35:30.159504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:35:30.159504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:35:30.159504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: 90b378551d1c467e911cf01274c97d85 May 28 17:35:30.159504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-AttachVolumeTestJSON-1064743775 May 28 17:35:30.159504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:35:30.159504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:35:30.160998 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90b378551d1c467e911cf01274c97d85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90b378551d1c467e911cf01274c97d85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/90b378551d1c467e911cf01274c97d85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_90b378551d1c467e911cf01274c97d85", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:35:30.160998 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-AttachVolumeTestJSON-1064743775 May 28 17:35:30.160998 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 90b378551d1c467e911cf01274c97d85 May 28 17:35:30.160998 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1064743775 May 28 17:35:30.160998 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-AttachVolumeTestJSON-1064743775-project May 28 17:35:30.160998 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:35:30.160998 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:35:30.160998 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: 7fcc62869ac34381a2327be46511137b May 28 17:35:30.160998 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-AttachVolumeTestJSON-1064743775-project May 28 17:35:30.160998 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: > May 28 17:35:30.160998 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Instance 3b3c1f29-31c9-4f5c-9875-fd1939062512 could not be found. May 28 17:35:30.160998 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'id': '3b3c1f29-31c9-4f5c-9875-fd1939062512'} May 28 17:35:30.162385 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:35:30.162385 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:35:30.162385 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:35:30.162385 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:35:30.162385 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:35:30.162385 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:35:30.162385 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:35:30.162385 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:35:30.162385 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:35:30.162385 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:35:30.162385 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b3c1f29-31c9-4f5c-9875-fd1939062512 could not be found. May 28 17:35:30.162385 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:35:30.162385 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:35:30.162385 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:35:30.162385 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:35:30.162385 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:35:30.162385 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:35:30.162385 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:35:30.162385 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:35:30.162385 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:35:30.164204 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:35:30.164204 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 17:35:30.164204 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 17:35:30.164204 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 17:35:30.164204 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 17:35:30.164204 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:35:30.164204 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:35:30.164204 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:35:30.164204 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:35:30.164204 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b3c1f29-31c9-4f5c-9875-fd1939062512 could not be found. May 28 17:35:30.164204 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:35:30.164204 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:35:30.164204 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:35:30.164204 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:35:30.164204 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:35:30.164204 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:35:30.164204 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:35:30.164204 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:35:30.164204 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b3c1f29-31c9-4f5c-9875-fd1939062512 could not be found. May 28 17:35:30.164204 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:35:30.165637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-4b8f016a-fa23-49c7-a70a-063f7914b52e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Returning 404 to user: Instance 3b3c1f29-31c9-4f5c-9875-fd1939062512 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:35:30.165637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-4b8f016a-fa23-49c7-a70a-063f7914b52e tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 404 len: 111 microversion: 2.1 time: 0.032998 May 28 17:35:30.165637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 517/1028] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 17:35:30 2022] DELETE /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:35:30.170425 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4992a930-cec9-4fb2-8364-66bc1f3f2220 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:30.171101 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4992a930-cec9-4fb2-8364-66bc1f3f2220 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] [instance: 3b3c1f29-31c9-4f5c-9875-fd1939062512] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:30.180777 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4992a930-cec9-4fb2-8364-66bc1f3f2220 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:30.181019 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-52a7173e-4166-4c79-bfad-4ba6d90a1f7e tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:30.181649 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-52a7173e-4166-4c79-bfad-4ba6d90a1f7e tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:30.181784 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4992a930-cec9-4fb2-8364-66bc1f3f2220 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:30.182699 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4992a930-cec9-4fb2-8364-66bc1f3f2220 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:30.183287 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4992a930-cec9-4fb2-8364-66bc1f3f2220 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:30.192628 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-52a7173e-4166-4c79-bfad-4ba6d90a1f7e tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:30.193123 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-52a7173e-4166-4c79-bfad-4ba6d90a1f7e tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:30.194303 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-52a7173e-4166-4c79-bfad-4ba6d90a1f7e tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:30.195262 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-52a7173e-4166-4c79-bfad-4ba6d90a1f7e tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:30.199118 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-4992a930-cec9-4fb2-8364-66bc1f3f2220 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] HTTP exception thrown: Instance 3b3c1f29-31c9-4f5c-9875-fd1939062512 could not be found. May 28 17:35:30.200697 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4992a930-cec9-4fb2-8364-66bc1f3f2220 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Request method failure captured: May 28 17:35:30.200697 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 HTTP/1.1 May 28 17:35:30.200697 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept: application/json May 28 17:35:30.200697 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity May 28 17:35:30.200697 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Connection: close May 28 17:35:30.200697 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Length: 0 May 28 17:35:30.200697 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Type: application/json May 28 17:35:30.200697 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 May 28 17:35:30.200697 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None May 28 17:35:30.200697 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 May 28 17:35:30.200697 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABiklsQwaALxIpoi-IQH5ulhomUzFtt0EHGvqFk34aslFHgcc8sGBZCHK9ucNqV3kceChC4qsoegwSUz42jW60ch9icnM2zXQM0e-3SG5KJN4XJR0zFETmt9esiUnyT2CHSaBoujBd1aDkt7nYWHIo-UDHEDTjlbPZknmx1CMAICvmILgM May 28 17:35:30.200697 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Id: None May 28 17:35:30.200697 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Name: None May 28 17:35:30.200697 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed May 28 17:35:30.200697 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True May 28 17:35:30.200697 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default May 28 17:35:30.200697 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default May 28 17:35:30.200697 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Id: 90b378551d1c467e911cf01274c97d85 May 28 17:35:30.200697 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeTestJSON-1064743775 May 28 17:35:30.200697 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Role: reader,member May 28 17:35:30.200697 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Roles: reader,member May 28 17:35:30.202260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90b378551d1c467e911cf01274c97d85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/90b378551d1c467e911cf01274c97d85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/90b378551d1c467e911cf01274c97d85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_90b378551d1c467e911cf01274c97d85", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:35:30.202260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeTestJSON-1064743775 May 28 17:35:30.202260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 90b378551d1c467e911cf01274c97d85 May 28 17:35:30.202260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1064743775 May 28 17:35:30.202260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeTestJSON-1064743775-project May 28 17:35:30.202260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default May 28 17:35:30.202260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default May 28 17:35:30.202260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Id: 7fcc62869ac34381a2327be46511137b May 28 17:35:30.202260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeTestJSON-1064743775-project May 28 17:35:30.202260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: method: > May 28 17:35:30.202260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: exception: Instance 3b3c1f29-31c9-4f5c-9875-fd1939062512 could not be found. May 28 17:35:30.202260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: action_args: {'id': '3b3c1f29-31c9-4f5c-9875-fd1939062512'} May 28 17:35:30.204021 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:35:30.204021 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:35:30.204021 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:35:30.204021 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:35:30.204021 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:35:30.204021 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:35:30.204021 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:35:30.204021 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:35:30.204021 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:35:30.204021 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:35:30.204021 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b3c1f29-31c9-4f5c-9875-fd1939062512 could not be found. May 28 17:35:30.204021 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:35:30.204021 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:35:30.204021 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:35:30.204021 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:35:30.204021 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:35:30.204021 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:35:30.204021 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:35:30.204021 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:35:30.204021 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:35:30.205426 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:35:30.205426 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:35:30.205426 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:35:30.205426 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:35:30.205426 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:35:30.205426 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:35:30.205426 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:35:30.205426 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b3c1f29-31c9-4f5c-9875-fd1939062512 could not be found. May 28 17:35:30.205426 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:35:30.205426 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:35:30.205426 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:35:30.205426 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:35:30.205426 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:35:30.205426 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:35:30.205426 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:35:30.205426 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:35:30.205426 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b3c1f29-31c9-4f5c-9875-fd1939062512 could not be found. May 28 17:35:30.205426 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:35:30.207682 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4992a930-cec9-4fb2-8364-66bc1f3f2220 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] Returning 404 to user: Instance 3b3c1f29-31c9-4f5c-9875-fd1939062512 could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:35:30.209113 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4992a930-cec9-4fb2-8364-66bc1f3f2220 tempest-AttachVolumeTestJSON-1064743775 tempest-AttachVolumeTestJSON-1064743775-project] 10.222.0.33 "GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512" status: 404 len: 111 microversion: 2.1 time: 0.042120 May 28 17:35:30.209835 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 512/1029] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:35:30 2022] GET /compute/v2.1/servers/3b3c1f29-31c9-4f5c-9875-fd1939062512 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:35:30.278141 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-52a7173e-4166-4c79-bfad-4ba6d90a1f7e tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:30.285464 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-52a7173e-4166-4c79-bfad-4ba6d90a1f7e tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d" status: 200 len: 1300 microversion: 2.1 time: 0.111043 May 28 17:35:30.286058 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 518/1030] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:35:30 2022] GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d => generated 1300 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:35:31.302051 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-75f2e034-379e-47e6-9f2b-568ed87b2b53 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:31.302749 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-75f2e034-379e-47e6-9f2b-568ed87b2b53 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:31.309458 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-75f2e034-379e-47e6-9f2b-568ed87b2b53 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:31.309920 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-75f2e034-379e-47e6-9f2b-568ed87b2b53 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:31.310698 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-75f2e034-379e-47e6-9f2b-568ed87b2b53 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:31.311144 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-75f2e034-379e-47e6-9f2b-568ed87b2b53 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:31.574893 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-75f2e034-379e-47e6-9f2b-568ed87b2b53 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:31.588692 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-75f2e034-379e-47e6-9f2b-568ed87b2b53 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d" status: 200 len: 1367 microversion: 2.1 time: 0.290290 May 28 17:35:31.598894 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 513/1031] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:35:31 2022] GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:35:31.757367 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-9168e4d9-a467-4cc3-b08f-22908d608d0b req-9486a611-b137-433d-8285-e17095d34b86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a72ea47-a87d-4716-981b-423fe0a0d60d", "tag": "25a0a848-b7b0-4228-8b72-fbe8936a2352"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:35:31.767856 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-9168e4d9-a467-4cc3-b08f-22908d608d0b req-9486a611-b137-433d-8285-e17095d34b86 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:31.768474 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-9168e4d9-a467-4cc3-b08f-22908d608d0b req-9486a611-b137-433d-8285-e17095d34b86 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:31.781515 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-9168e4d9-a467-4cc3-b08f-22908d608d0b req-9486a611-b137-433d-8285-e17095d34b86 service nova] Creating event network-changed:25a0a848-b7b0-4228-8b72-fbe8936a2352 for instance 9a72ea47-a87d-4716-981b-423fe0a0d60d on hv-cinder-84372 May 28 17:35:31.790248 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-9168e4d9-a467-4cc3-b08f-22908d608d0b req-9486a611-b137-433d-8285-e17095d34b86 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037646 May 28 17:35:31.791150 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 519/1032] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:35:32.606034 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f6d4121c-ed89-4794-b96e-df94366c7a58 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:32.606665 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f6d4121c-ed89-4794-b96e-df94366c7a58 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:32.613203 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f6d4121c-ed89-4794-b96e-df94366c7a58 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:32.613663 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f6d4121c-ed89-4794-b96e-df94366c7a58 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:32.614436 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f6d4121c-ed89-4794-b96e-df94366c7a58 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:32.615444 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f6d4121c-ed89-4794-b96e-df94366c7a58 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:32.631084 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=100 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:35:32.760263 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f6d4121c-ed89-4794-b96e-df94366c7a58 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:32.767722 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f6d4121c-ed89-4794-b96e-df94366c7a58 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d" status: 200 len: 1367 microversion: 2.1 time: 0.165595 May 28 17:35:32.768400 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 514/1033] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:35:32 2022] GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:35:33.786873 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d9ed8886-70f2-415b-91d3-b99f2f74becf tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:33.787740 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d9ed8886-70f2-415b-91d3-b99f2f74becf tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:33.793869 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d9ed8886-70f2-415b-91d3-b99f2f74becf tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:33.794311 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d9ed8886-70f2-415b-91d3-b99f2f74becf tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:33.795077 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d9ed8886-70f2-415b-91d3-b99f2f74becf tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:33.795542 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d9ed8886-70f2-415b-91d3-b99f2f74becf tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:33.932976 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d9ed8886-70f2-415b-91d3-b99f2f74becf tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:33.940389 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d9ed8886-70f2-415b-91d3-b99f2f74becf tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d" status: 200 len: 1367 microversion: 2.1 time: 0.158474 May 28 17:35:33.940950 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 520/1034] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:35:33 2022] GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:35:34.957436 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5d4b7157-af9d-4cb7-8580-9043e758c916 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:34.958942 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5d4b7157-af9d-4cb7-8580-9043e758c916 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:34.965888 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5d4b7157-af9d-4cb7-8580-9043e758c916 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:34.966609 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5d4b7157-af9d-4cb7-8580-9043e758c916 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:34.967636 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5d4b7157-af9d-4cb7-8580-9043e758c916 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:34.968323 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5d4b7157-af9d-4cb7-8580-9043e758c916 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:35.138990 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5d4b7157-af9d-4cb7-8580-9043e758c916 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:35.149411 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5d4b7157-af9d-4cb7-8580-9043e758c916 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d" status: 200 len: 1367 microversion: 2.1 time: 0.195076 May 28 17:35:35.151111 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 515/1035] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:35:34 2022] GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:35:36.166701 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ec945b14-1848-423f-8b73-8b3e2a8b3a37 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:36.167321 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ec945b14-1848-423f-8b73-8b3e2a8b3a37 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:36.174009 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ec945b14-1848-423f-8b73-8b3e2a8b3a37 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:36.174462 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ec945b14-1848-423f-8b73-8b3e2a8b3a37 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:36.175313 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ec945b14-1848-423f-8b73-8b3e2a8b3a37 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:36.175836 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ec945b14-1848-423f-8b73-8b3e2a8b3a37 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:36.307868 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ec945b14-1848-423f-8b73-8b3e2a8b3a37 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:36.315390 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ec945b14-1848-423f-8b73-8b3e2a8b3a37 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d" status: 200 len: 1367 microversion: 2.1 time: 0.152641 May 28 17:35:36.315947 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 521/1036] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:35:36 2022] GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:35:37.318892 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-6d42fcb1-8f42-4572-937e-fcec01fd9e7b req-0b42d875-fbbc-466c-a85b-8b5081ef9499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a72ea47-a87d-4716-981b-423fe0a0d60d", "name": "network-vif-plugged", "status": "completed", "tag": "25a0a848-b7b0-4228-8b72-fbe8936a2352"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:35:37.328044 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-6d42fcb1-8f42-4572-937e-fcec01fd9e7b req-0b42d875-fbbc-466c-a85b-8b5081ef9499 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:37.328854 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-6d42fcb1-8f42-4572-937e-fcec01fd9e7b req-0b42d875-fbbc-466c-a85b-8b5081ef9499 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:37.332260 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-32fec57a-208f-4b1d-a5f8-8ea027ad9f05 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:37.333980 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-32fec57a-208f-4b1d-a5f8-8ea027ad9f05 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:37.340875 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-32fec57a-208f-4b1d-a5f8-8ea027ad9f05 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:37.341463 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-32fec57a-208f-4b1d-a5f8-8ea027ad9f05 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:37.342299 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-32fec57a-208f-4b1d-a5f8-8ea027ad9f05 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:37.342806 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-32fec57a-208f-4b1d-a5f8-8ea027ad9f05 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:37.343324 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-6d42fcb1-8f42-4572-937e-fcec01fd9e7b req-0b42d875-fbbc-466c-a85b-8b5081ef9499 service nova] Creating event network-vif-plugged:25a0a848-b7b0-4228-8b72-fbe8936a2352 for instance 9a72ea47-a87d-4716-981b-423fe0a0d60d on hv-cinder-84372 May 28 17:35:37.348713 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-6d42fcb1-8f42-4572-937e-fcec01fd9e7b req-0b42d875-fbbc-466c-a85b-8b5081ef9499 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033606 May 28 17:35:37.350449 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 516/1037] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:35:37.477940 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-32fec57a-208f-4b1d-a5f8-8ea027ad9f05 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:37.485776 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-32fec57a-208f-4b1d-a5f8-8ea027ad9f05 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d" status: 200 len: 1367 microversion: 2.1 time: 0.157259 May 28 17:35:37.486420 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 522/1038] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:35:37 2022] GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:35:38.504105 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0bf9208a-0908-44d6-ba8b-657e7b3f2d50 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:38.504800 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0bf9208a-0908-44d6-ba8b-657e7b3f2d50 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:38.511686 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0bf9208a-0908-44d6-ba8b-657e7b3f2d50 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:38.512136 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0bf9208a-0908-44d6-ba8b-657e7b3f2d50 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:38.512897 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0bf9208a-0908-44d6-ba8b-657e7b3f2d50 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:38.513334 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0bf9208a-0908-44d6-ba8b-657e7b3f2d50 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:38.658283 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0bf9208a-0908-44d6-ba8b-657e7b3f2d50 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:38.665658 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0bf9208a-0908-44d6-ba8b-657e7b3f2d50 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d" status: 200 len: 1367 microversion: 2.1 time: 0.166408 May 28 17:35:38.666221 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 517/1039] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:35:38 2022] GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:35:39.681997 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1c9b27f1-99d9-4379-8ee9-c2529e95bda9 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:39.682646 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1c9b27f1-99d9-4379-8ee9-c2529e95bda9 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:39.685042 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:35:39.685703 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=6 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:35:39.691962 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c9b27f1-99d9-4379-8ee9-c2529e95bda9 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:39.693009 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c9b27f1-99d9-4379-8ee9-c2529e95bda9 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:39.693962 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c9b27f1-99d9-4379-8ee9-c2529e95bda9 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:39.694403 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c9b27f1-99d9-4379-8ee9-c2529e95bda9 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:39.698608 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:35:39.826675 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1c9b27f1-99d9-4379-8ee9-c2529e95bda9 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:39.834860 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1c9b27f1-99d9-4379-8ee9-c2529e95bda9 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d" status: 200 len: 1367 microversion: 2.1 time: 0.156841 May 28 17:35:39.835437 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 523/1040] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:35:39 2022] GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:35:40.852168 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2e0762f4-c95b-4bef-85eb-341268ed59bc tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:40.852776 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2e0762f4-c95b-4bef-85eb-341268ed59bc tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:40.854711 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=6 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:35:40.860666 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2e0762f4-c95b-4bef-85eb-341268ed59bc tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:40.861119 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2e0762f4-c95b-4bef-85eb-341268ed59bc tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:40.861879 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2e0762f4-c95b-4bef-85eb-341268ed59bc tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:40.862317 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2e0762f4-c95b-4bef-85eb-341268ed59bc tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:40.990438 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2e0762f4-c95b-4bef-85eb-341268ed59bc tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:40.997873 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2e0762f4-c95b-4bef-85eb-341268ed59bc tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d" status: 200 len: 1367 microversion: 2.1 time: 0.150194 May 28 17:35:40.998435 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 518/1041] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:35:40 2022] GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:35:42.014199 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0226e080-2151-48eb-9dd1-3ccfb0f8841d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:42.014726 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0226e080-2151-48eb-9dd1-3ccfb0f8841d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:42.021561 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0226e080-2151-48eb-9dd1-3ccfb0f8841d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:42.022001 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0226e080-2151-48eb-9dd1-3ccfb0f8841d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:42.022758 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0226e080-2151-48eb-9dd1-3ccfb0f8841d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:42.023193 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0226e080-2151-48eb-9dd1-3ccfb0f8841d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:42.152914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0226e080-2151-48eb-9dd1-3ccfb0f8841d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:42.160293 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0226e080-2151-48eb-9dd1-3ccfb0f8841d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d" status: 200 len: 1367 microversion: 2.1 time: 0.150087 May 28 17:35:42.160848 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 524/1042] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:35:42 2022] GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:35:43.177943 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0a5e0e80-3c45-4399-bfd5-e846b2cf9ec8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:43.178498 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0a5e0e80-3c45-4399-bfd5-e846b2cf9ec8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:43.185067 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0a5e0e80-3c45-4399-bfd5-e846b2cf9ec8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:43.185539 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0a5e0e80-3c45-4399-bfd5-e846b2cf9ec8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:43.186277 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0a5e0e80-3c45-4399-bfd5-e846b2cf9ec8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:43.186712 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0a5e0e80-3c45-4399-bfd5-e846b2cf9ec8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:43.321569 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0a5e0e80-3c45-4399-bfd5-e846b2cf9ec8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:35:43.328981 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0a5e0e80-3c45-4399-bfd5-e846b2cf9ec8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d" status: 200 len: 1556 microversion: 2.1 time: 0.155411 May 28 17:35:43.329780 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 519/1043] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:35:43 2022] GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:35:43.345754 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e9acc727-dc51-402e-962d-cf066a0f6c25 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:35:43.346324 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e9acc727-dc51-402e-962d-cf066a0f6c25 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:35:43.353061 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e9acc727-dc51-402e-962d-cf066a0f6c25 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:43.353507 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e9acc727-dc51-402e-962d-cf066a0f6c25 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:43.354272 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e9acc727-dc51-402e-962d-cf066a0f6c25 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:43.354705 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e9acc727-dc51-402e-962d-cf066a0f6c25 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:43.439257 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e9acc727-dc51-402e-962d-cf066a0f6c25 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097430 May 28 17:35:43.439984 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 525/1044] 10.222.0.33 () {58 vars in 1274 bytes} [Sat May 28 17:35:43 2022] GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:35:44.606982 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-3094a9c1-2848-4fce-b7e9-874e689ebb7d req-a3ed049b-4015-4672-a31a-a68bd2603859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a72ea47-a87d-4716-981b-423fe0a0d60d", "tag": "25a0a848-b7b0-4228-8b72-fbe8936a2352"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:35:44.611800 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:35:44.616651 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-3094a9c1-2848-4fce-b7e9-874e689ebb7d req-a3ed049b-4015-4672-a31a-a68bd2603859 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:35:44.617093 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-3094a9c1-2848-4fce-b7e9-874e689ebb7d req-a3ed049b-4015-4672-a31a-a68bd2603859 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:35:44.629190 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-3094a9c1-2848-4fce-b7e9-874e689ebb7d req-a3ed049b-4015-4672-a31a-a68bd2603859 service nova] Creating event network-changed:25a0a848-b7b0-4228-8b72-fbe8936a2352 for instance 9a72ea47-a87d-4716-981b-423fe0a0d60d on hv-cinder-84372 May 28 17:35:44.635006 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-3094a9c1-2848-4fce-b7e9-874e689ebb7d req-a3ed049b-4015-4672-a31a-a68bd2603859 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032262 May 28 17:35:44.636090 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 520/1045] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:36:25.588004 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:36:25.589234 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=14 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:36:25.593244 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-741eb453-3055-40c4-b527-2d8d7623fe36 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:36:25.593816 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-741eb453-3055-40c4-b527-2d8d7623fe36 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:36:25.595100 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=31 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:36:25.596932 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:36:25.605651 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-741eb453-3055-40c4-b527-2d8d7623fe36 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:25.606440 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-741eb453-3055-40c4-b527-2d8d7623fe36 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:25.607293 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-741eb453-3055-40c4-b527-2d8d7623fe36 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:25.607984 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-741eb453-3055-40c4-b527-2d8d7623fe36 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:25.636624 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-741eb453-3055-40c4-b527-2d8d7623fe36 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Going to try to terminate instance {{(pid=117604) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 17:36:25.730786 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-3bf0af77-7ced-439f-a0e2-04777887a819 req-14a57b14-8654-408a-9374-6534009740f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "281e6309-8591-49e7-ab2a-e36aa0fad594", "tag": "50d0ffcf-e908-48f5-9b29-2b70709081b6"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:36:25.738372 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-741eb453-3055-40c4-b527-2d8d7623fe36 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "DELETE /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 204 len: 0 microversion: 2.1 time: 0.152082 May 28 17:36:25.739167 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-3bf0af77-7ced-439f-a0e2-04777887a819 req-14a57b14-8654-408a-9374-6534009740f9 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:25.739602 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 526/1046] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 17:36:25 2022] DELETE /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 17:36:25.739718 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-3bf0af77-7ced-439f-a0e2-04777887a819 req-14a57b14-8654-408a-9374-6534009740f9 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:25.748662 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f3819a9b-bd37-43a2-b572-9fc610c73027 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:36:25.749383 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f3819a9b-bd37-43a2-b572-9fc610c73027 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:36:25.755581 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-3bf0af77-7ced-439f-a0e2-04777887a819 req-14a57b14-8654-408a-9374-6534009740f9 service nova] Creating event network-changed:50d0ffcf-e908-48f5-9b29-2b70709081b6 for instance 281e6309-8591-49e7-ab2a-e36aa0fad594 on hv-cinder-84372 May 28 17:36:25.756147 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f3819a9b-bd37-43a2-b572-9fc610c73027 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:25.756376 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f3819a9b-bd37-43a2-b572-9fc610c73027 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:25.757141 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f3819a9b-bd37-43a2-b572-9fc610c73027 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:25.757572 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f3819a9b-bd37-43a2-b572-9fc610c73027 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:25.760978 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-3bf0af77-7ced-439f-a0e2-04777887a819 req-14a57b14-8654-408a-9374-6534009740f9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172211 May 28 17:36:25.763219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 521/1047] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:36:25.892599 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f3819a9b-bd37-43a2-b572-9fc610c73027 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:36:25.901003 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f3819a9b-bd37-43a2-b572-9fc610c73027 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1571 microversion: 2.1 time: 0.156841 May 28 17:36:25.901578 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 527/1048] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:36:25 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:36:26.919064 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e5bc7292-b3f0-4ec1-916f-cb90a45234b1 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:36:26.919826 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-e5bc7292-b3f0-4ec1-916f-cb90a45234b1 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:36:26.926968 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e5bc7292-b3f0-4ec1-916f-cb90a45234b1 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:26.927489 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e5bc7292-b3f0-4ec1-916f-cb90a45234b1 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:26.928256 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e5bc7292-b3f0-4ec1-916f-cb90a45234b1 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:26.928696 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e5bc7292-b3f0-4ec1-916f-cb90a45234b1 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:27.063063 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-e5bc7292-b3f0-4ec1-916f-cb90a45234b1 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:36:27.072556 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-e5bc7292-b3f0-4ec1-916f-cb90a45234b1 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1571 microversion: 2.1 time: 0.157900 May 28 17:36:27.073064 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 522/1049] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:36:26 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:36:28.090118 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-70a708c5-6b0b-4574-9b80-7a368786c6b6 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:36:28.091763 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-70a708c5-6b0b-4574-9b80-7a368786c6b6 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:36:28.098385 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-70a708c5-6b0b-4574-9b80-7a368786c6b6 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:28.099590 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-70a708c5-6b0b-4574-9b80-7a368786c6b6 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:28.100605 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-70a708c5-6b0b-4574-9b80-7a368786c6b6 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:28.101614 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-70a708c5-6b0b-4574-9b80-7a368786c6b6 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:28.294716 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-70a708c5-6b0b-4574-9b80-7a368786c6b6 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:36:28.302949 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-70a708c5-6b0b-4574-9b80-7a368786c6b6 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1571 microversion: 2.1 time: 0.216566 May 28 17:36:28.308620 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 528/1050] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:36:28 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1571 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:36:28.380989 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-153788a2-64c3-4ad7-8034-2c25beb83a19 req-376dcc7e-f0f6-4a54-9f42-309be3981ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "281e6309-8591-49e7-ab2a-e36aa0fad594", "name": "network-vif-deleted", "tag": "50d0ffcf-e908-48f5-9b29-2b70709081b6"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:36:28.390007 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-153788a2-64c3-4ad7-8034-2c25beb83a19 req-376dcc7e-f0f6-4a54-9f42-309be3981ec0 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:28.390566 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-153788a2-64c3-4ad7-8034-2c25beb83a19 req-376dcc7e-f0f6-4a54-9f42-309be3981ec0 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:28.402395 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-153788a2-64c3-4ad7-8034-2c25beb83a19 req-376dcc7e-f0f6-4a54-9f42-309be3981ec0 service nova] Creating event network-vif-deleted:50d0ffcf-e908-48f5-9b29-2b70709081b6 for instance 281e6309-8591-49e7-ab2a-e36aa0fad594 on hv-cinder-84372 May 28 17:36:28.407415 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-153788a2-64c3-4ad7-8034-2c25beb83a19 req-376dcc7e-f0f6-4a54-9f42-309be3981ec0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031079 May 28 17:36:28.408127 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 523/1051] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:36:29.320458 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ed5c4f4a-15ba-4736-831e-292ef6f2338b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:36:29.321277 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ed5c4f4a-15ba-4736-831e-292ef6f2338b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:36:29.328346 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ed5c4f4a-15ba-4736-831e-292ef6f2338b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:29.328808 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ed5c4f4a-15ba-4736-831e-292ef6f2338b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:29.329602 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ed5c4f4a-15ba-4736-831e-292ef6f2338b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:29.330036 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ed5c4f4a-15ba-4736-831e-292ef6f2338b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:29.366861 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ed5c4f4a-15ba-4736-831e-292ef6f2338b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:29.367416 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ed5c4f4a-15ba-4736-831e-292ef6f2338b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:29.367976 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-ed5c4f4a-15ba-4736-831e-292ef6f2338b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lazy-loading 'fault' on Instance uuid 281e6309-8591-49e7-ab2a-e36aa0fad594 {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 17:36:29.433019 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ed5c4f4a-15ba-4736-831e-292ef6f2338b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c83f7ad6e94f34b7bd9a335ee52257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1187f363c0d40ffaebe938d3201e0ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:36:29.441031 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ed5c4f4a-15ba-4736-831e-292ef6f2338b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 200 len: 1179 microversion: 2.1 time: 0.124796 May 28 17:36:29.441707 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 529/1052] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:36:29 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 1179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:36:30.459742 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a6b4a0e5-c4d8-4c5e-a8f1-128f4f11dc4b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:36:30.460604 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a6b4a0e5-c4d8-4c5e-a8f1-128f4f11dc4b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] [instance: 281e6309-8591-49e7-ab2a-e36aa0fad594] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:36:30.469436 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a6b4a0e5-c4d8-4c5e-a8f1-128f4f11dc4b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:30.469872 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a6b4a0e5-c4d8-4c5e-a8f1-128f4f11dc4b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:30.470718 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a6b4a0e5-c4d8-4c5e-a8f1-128f4f11dc4b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:30.471168 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a6b4a0e5-c4d8-4c5e-a8f1-128f4f11dc4b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:30.485111 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-a6b4a0e5-c4d8-4c5e-a8f1-128f4f11dc4b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] HTTP exception thrown: Instance 281e6309-8591-49e7-ab2a-e36aa0fad594 could not be found. May 28 17:36:30.486768 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a6b4a0e5-c4d8-4c5e-a8f1-128f4f11dc4b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Request method failure captured: May 28 17:36:30.486768 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 HTTP/1.1 May 28 17:36:30.486768 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept: application/json May 28 17:36:30.486768 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity May 28 17:36:30.486768 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Connection: close May 28 17:36:30.486768 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Length: 0 May 28 17:36:30.486768 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Type: application/json May 28 17:36:30.486768 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 May 28 17:36:30.486768 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None May 28 17:36:30.486768 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 May 28 17:36:30.486768 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABiklw7BrE47SGMsrAcnZl78b2EMRKaMHPhW7Bq4Eh_OzigYWq-XsI5jtcmDg3slO8HBwqrEBv98XeTMa5Va4vkpLgknk-IHt8U4KxAmxAc8oNZoFhwA4qrSclV5IBt17tBu33mnhfs0PAXuHTPTmyY-M3cqMv8-S7GSBgyMrnl0nU6Y7k May 28 17:36:30.486768 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Id: None May 28 17:36:30.486768 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Name: None May 28 17:36:30.486768 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed May 28 17:36:30.486768 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True May 28 17:36:30.486768 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default May 28 17:36:30.486768 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default May 28 17:36:30.486768 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Id: c1187f363c0d40ffaebe938d3201e0ad May 28 17:36:30.486768 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-TestShelveInstance-1750145619 May 28 17:36:30.486768 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Role: reader,member May 28 17:36:30.486768 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Roles: reader,member May 28 17:36:30.488483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c1187f363c0d40ffaebe938d3201e0ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c1187f363c0d40ffaebe938d3201e0ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c1187f363c0d40ffaebe938d3201e0ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c1187f363c0d40ffaebe938d3201e0ad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:36:30.488483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-TestShelveInstance-1750145619 May 28 17:36:30.488483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Id: c1187f363c0d40ffaebe938d3201e0ad May 28 17:36:30.488483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-TestShelveInstance-1750145619 May 28 17:36:30.488483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User: tempest-TestShelveInstance-1750145619-project May 28 17:36:30.488483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default May 28 17:36:30.488483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default May 28 17:36:30.488483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Id: 10c83f7ad6e94f34b7bd9a335ee52257 May 28 17:36:30.488483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-TestShelveInstance-1750145619-project May 28 17:36:30.488483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: method: > May 28 17:36:30.488483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: exception: Instance 281e6309-8591-49e7-ab2a-e36aa0fad594 could not be found. May 28 17:36:30.488483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: action_args: {'id': '281e6309-8591-49e7-ab2a-e36aa0fad594'} May 28 17:36:30.490326 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:36:30.490326 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:36:30.490326 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:36:30.490326 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:36:30.490326 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:36:30.490326 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:36:30.490326 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:36:30.490326 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:36:30.490326 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:36:30.490326 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:36:30.490326 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 281e6309-8591-49e7-ab2a-e36aa0fad594 could not be found. May 28 17:36:30.490326 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:36:30.490326 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:36:30.490326 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:36:30.490326 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:36:30.490326 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:36:30.490326 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:36:30.490326 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:36:30.490326 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:36:30.490326 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:36:30.491905 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:36:30.491905 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:36:30.491905 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:36:30.491905 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:36:30.491905 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:36:30.491905 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:36:30.491905 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:36:30.491905 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 281e6309-8591-49e7-ab2a-e36aa0fad594 could not be found. May 28 17:36:30.491905 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:36:30.491905 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:36:30.491905 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:36:30.491905 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:36:30.491905 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:36:30.491905 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:36:30.491905 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:36:30.491905 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:36:30.491905 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 281e6309-8591-49e7-ab2a-e36aa0fad594 could not be found. May 28 17:36:30.491905 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:36:30.493469 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a6b4a0e5-c4d8-4c5e-a8f1-128f4f11dc4b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Returning 404 to user: Instance 281e6309-8591-49e7-ab2a-e36aa0fad594 could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:36:30.493469 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a6b4a0e5-c4d8-4c5e-a8f1-128f4f11dc4b tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594" status: 404 len: 111 microversion: 2.1 time: 0.034111 May 28 17:36:30.493469 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 524/1053] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:36:30 2022] GET /compute/v2.1/servers/281e6309-8591-49e7-ab2a-e36aa0fad594 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:36:30.655290 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8083da58-ebae-441b-a3ea-80915fe3dde5 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] Calling method '.version_select at 0x7f9efcc794c0>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:36:30.679076 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8083da58-ebae-441b-a3ea-80915fe3dde5 tempest-TestShelveInstance-1750145619 tempest-TestShelveInstance-1750145619-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1490599223" status: 202 len: 0 microversion: 2.1 time: 0.027376 May 28 17:36:30.679756 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 530/1054] 10.222.0.33 () {58 vars in 1253 bytes} [Sat May 28 17:36:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1490599223 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 17:36:45.125695 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7f68d119-5f09-47f0-b599-78c059d8b5e4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:36:45.126624 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7f68d119-5f09-47f0-b599-78c059d8b5e4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:36:45.133805 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=8 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:36:45.147515 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=12 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:36:45.149777 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7f68d119-5f09-47f0-b599-78c059d8b5e4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:45.150547 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7f68d119-5f09-47f0-b599-78c059d8b5e4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:45.151648 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7f68d119-5f09-47f0-b599-78c059d8b5e4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:45.152610 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7f68d119-5f09-47f0-b599-78c059d8b5e4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:45.202101 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7f68d119-5f09-47f0-b599-78c059d8b5e4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.080286 May 28 17:36:45.202690 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 525/1055] 10.222.0.33 () {60 vars in 1342 bytes} [Sat May 28 17:36:45 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:36:45.275399 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e7f839ab-9536-4b56-8351-5304eeb232aa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:36:45.276607 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e7f839ab-9536-4b56-8351-5304eeb232aa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:36:45.279673 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:36:45.280897 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:36:45.289180 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e7f839ab-9536-4b56-8351-5304eeb232aa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:45.290132 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e7f839ab-9536-4b56-8351-5304eeb232aa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:45.291195 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e7f839ab-9536-4b56-8351-5304eeb232aa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:45.291855 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e7f839ab-9536-4b56-8351-5304eeb232aa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:45.337974 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e7f839ab-9536-4b56-8351-5304eeb232aa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Going to try to terminate instance {{(pid=117604) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 17:36:45.437129 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e7f839ab-9536-4b56-8351-5304eeb232aa tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "DELETE /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 204 len: 0 microversion: 2.20 time: 0.165828 May 28 17:36:45.437828 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 531/1056] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 17:36:45 2022] DELETE /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 28 17:36:45.446459 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0da738bd-ba65-4b36-baa9-c53d2c0d70df tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:36:45.447084 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0da738bd-ba65-4b36-baa9-c53d2c0d70df tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:36:45.453381 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0da738bd-ba65-4b36-baa9-c53d2c0d70df tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:45.454131 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0da738bd-ba65-4b36-baa9-c53d2c0d70df tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:45.455043 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0da738bd-ba65-4b36-baa9-c53d2c0d70df tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:45.455529 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0da738bd-ba65-4b36-baa9-c53d2c0d70df tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:45.932878 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0da738bd-ba65-4b36-baa9-c53d2c0d70df tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:36:45.940991 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0da738bd-ba65-4b36-baa9-c53d2c0d70df tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:36:45.942844 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0da738bd-ba65-4b36-baa9-c53d2c0d70df tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:36:45.944372 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0da738bd-ba65-4b36-baa9-c53d2c0d70df tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1723 microversion: 2.20 time: 0.501997 May 28 17:36:45.944849 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 526/1057] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:36:45 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1723 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:36:46.965010 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-42e514cc-c986-44b3-8872-f2e4c0fec4ec tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:36:46.965689 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-42e514cc-c986-44b3-8872-f2e4c0fec4ec tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:36:46.974204 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-42e514cc-c986-44b3-8872-f2e4c0fec4ec tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:46.974667 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-42e514cc-c986-44b3-8872-f2e4c0fec4ec tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:46.975471 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-42e514cc-c986-44b3-8872-f2e4c0fec4ec tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:46.975913 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-42e514cc-c986-44b3-8872-f2e4c0fec4ec tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:47.262361 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-42e514cc-c986-44b3-8872-f2e4c0fec4ec tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:36:47.276068 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-42e514cc-c986-44b3-8872-f2e4c0fec4ec tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:36:47.280894 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-42e514cc-c986-44b3-8872-f2e4c0fec4ec tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:36:47.285710 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-42e514cc-c986-44b3-8872-f2e4c0fec4ec tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1723 microversion: 2.20 time: 0.321990 May 28 17:36:47.288514 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 532/1058] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:36:46 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1723 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:36:48.305828 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2f87183f-fc55-44a9-91ec-0c6b465a8f78 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:36:48.306788 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2f87183f-fc55-44a9-91ec-0c6b465a8f78 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:36:48.323772 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2f87183f-fc55-44a9-91ec-0c6b465a8f78 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:48.324272 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2f87183f-fc55-44a9-91ec-0c6b465a8f78 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:48.325109 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2f87183f-fc55-44a9-91ec-0c6b465a8f78 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:48.329267 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2f87183f-fc55-44a9-91ec-0c6b465a8f78 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:48.536588 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2f87183f-fc55-44a9-91ec-0c6b465a8f78 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:36:48.544932 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2f87183f-fc55-44a9-91ec-0c6b465a8f78 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:36:48.555557 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2f87183f-fc55-44a9-91ec-0c6b465a8f78 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:36:48.556776 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2f87183f-fc55-44a9-91ec-0c6b465a8f78 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1656 microversion: 2.20 time: 0.255945 May 28 17:36:48.570777 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 527/1059] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:36:48 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1656 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 17:36:49.596013 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-19e637ea-23e5-4012-b343-a58609e82748 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:36:49.599853 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-19e637ea-23e5-4012-b343-a58609e82748 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:36:49.607665 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-19e637ea-23e5-4012-b343-a58609e82748 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:49.608459 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-19e637ea-23e5-4012-b343-a58609e82748 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:49.609447 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-19e637ea-23e5-4012-b343-a58609e82748 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:49.610112 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-19e637ea-23e5-4012-b343-a58609e82748 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:49.614225 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-e94e58f4-6f81-4342-97b8-a521bd37d872 req-2b17508c-3a92-4505-b739-53e505a90b51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27322ac4-8704-4f1a-b431-e5c4ad7d77ad", "name": "network-vif-deleted", "tag": "e951fe87-910c-4495-88e9-a876c275be25"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:36:49.627008 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-e94e58f4-6f81-4342-97b8-a521bd37d872 req-2b17508c-3a92-4505-b739-53e505a90b51 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:49.627482 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-e94e58f4-6f81-4342-97b8-a521bd37d872 req-2b17508c-3a92-4505-b739-53e505a90b51 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:49.655548 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-e94e58f4-6f81-4342-97b8-a521bd37d872 req-2b17508c-3a92-4505-b739-53e505a90b51 service nova] Creating event network-vif-deleted:e951fe87-910c-4495-88e9-a876c275be25 for instance 27322ac4-8704-4f1a-b431-e5c4ad7d77ad on hv-cinder-84372 May 28 17:36:49.663317 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-e94e58f4-6f81-4342-97b8-a521bd37d872 req-2b17508c-3a92-4505-b739-53e505a90b51 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.521216 May 28 17:36:49.672673 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 533/1060] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:36:49.693104 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-19e637ea-23e5-4012-b343-a58609e82748 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:49.693910 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-19e637ea-23e5-4012-b343-a58609e82748 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:49.695511 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-19e637ea-23e5-4012-b343-a58609e82748 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lazy-loading 'fault' on Instance uuid 27322ac4-8704-4f1a-b431-e5c4ad7d77ad {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 17:36:49.766819 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-19e637ea-23e5-4012-b343-a58609e82748 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:36:49.804332 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-19e637ea-23e5-4012-b343-a58609e82748 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:36:49.808182 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-19e637ea-23e5-4012-b343-a58609e82748 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '710b406ba65646ed94c3f9d356b161f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afaaf8bde7134efc80c77d707bb309bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:36:49.812897 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-19e637ea-23e5-4012-b343-a58609e82748 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 200 len: 1371 microversion: 2.20 time: 0.229124 May 28 17:36:49.814113 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 528/1061] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:36:49 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 17:36:50.730280 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6a7d6be0-a7a9-4bda-9e83-c46c5542b779 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Action: 'create', calling method: .version_select at 0x7f9eeffb5dc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1169689163", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSf5lK9joVCUYL4Bju6lvpZbpuMeYWw+P7Gm3Ka4aK6cTiVBkKObgRlg8GAHOMia4Sk1Ns2JLi/wOPUs7LgjD6/kLmUgcLwFfutoqWDac2IuN3aJV02823ueKiMpy5Wqg=="}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:36:50.746211 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-6a7d6be0-a7a9-4bda-9e83-c46c5542b779 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Getting quotas for project 3785f78e6d1048cfa0b5b123fdd909c8. Resources: {'key_pairs'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:36:50.750476 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-6a7d6be0-a7a9-4bda-9e83-c46c5542b779 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Getting quotas for user 4a827bedc4b84508bb7770a09efee3f5 and project 3785f78e6d1048cfa0b5b123fdd909c8. Resources: {'key_pairs'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:36:50.776952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6a7d6be0-a7a9-4bda-9e83-c46c5542b779 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.173208 May 28 17:36:50.777588 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 534/1062] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 17:36:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:36:50.833281 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-80068854-de9c-4092-82cb-efda527df14b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:36:50.833846 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-80068854-de9c-4092-82cb-efda527df14b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:36:50.840572 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-80068854-de9c-4092-82cb-efda527df14b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:50.841513 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-80068854-de9c-4092-82cb-efda527df14b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:50.842245 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-80068854-de9c-4092-82cb-efda527df14b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:50.842935 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-80068854-de9c-4092-82cb-efda527df14b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:50.857538 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-80068854-de9c-4092-82cb-efda527df14b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] HTTP exception thrown: Instance 27322ac4-8704-4f1a-b431-e5c4ad7d77ad could not be found. May 28 17:36:50.859315 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-80068854-de9c-4092-82cb-efda527df14b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Request method failure captured: May 28 17:36:50.859315 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad HTTP/1.1 May 28 17:36:50.859315 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept: application/json May 28 17:36:50.859315 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity May 28 17:36:50.859315 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Connection: close May 28 17:36:50.859315 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Length: 0 May 28 17:36:50.859315 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Type: application/json May 28 17:36:50.859315 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 May 28 17:36:50.859315 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None May 28 17:36:50.859315 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 May 28 17:36:50.859315 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABiklt0ryigSES2va0FJ5urnH-xGPHxC2ofGmHZJwTcOlD6rM0ANKwwYZPb96v1LqEjiGMXf0HExZtWCwjd26LOuC9S5qOYFPKmaY81VW-Iz8BFNQMQ1GSjg9MeNtwueDXFDFVLCzX8HxCa7EJe3Wbi5d9p8fynqoJNgd_K7l6YAFVc3Zk May 28 17:36:50.859315 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Id: None May 28 17:36:50.859315 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Name: None May 28 17:36:50.859315 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed May 28 17:36:50.859315 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True May 28 17:36:50.859315 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Openstack-Nova-Api-Version: 2.20 May 28 17:36:50.859315 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default May 28 17:36:50.859315 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default May 28 17:36:50.859315 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Id: afaaf8bde7134efc80c77d707bb309bc May 28 17:36:50.859315 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-730962505 May 28 17:36:50.859315 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Role: reader,member May 28 17:36:50.859315 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Roles: reader,member May 28 17:36:50.861226 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afaaf8bde7134efc80c77d707bb309bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afaaf8bde7134efc80c77d707bb309bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/afaaf8bde7134efc80c77d707bb309bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_afaaf8bde7134efc80c77d707bb309bc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:36:50.861226 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeShelveTestJSON-730962505 May 28 17:36:50.861226 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Id: afaaf8bde7134efc80c77d707bb309bc May 28 17:36:50.861226 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-730962505 May 28 17:36:50.861226 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeShelveTestJSON-730962505-project May 28 17:36:50.861226 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default May 28 17:36:50.861226 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default May 28 17:36:50.861226 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Id: 710b406ba65646ed94c3f9d356b161f1 May 28 17:36:50.861226 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeShelveTestJSON-730962505-project May 28 17:36:50.861226 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: method: > May 28 17:36:50.861226 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: exception: Instance 27322ac4-8704-4f1a-b431-e5c4ad7d77ad could not be found. May 28 17:36:50.861226 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: action_args: {'id': '27322ac4-8704-4f1a-b431-e5c4ad7d77ad'} May 28 17:36:50.862238 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:36:50.862238 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:36:50.862238 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:36:50.862238 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:36:50.862238 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:36:50.862238 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:36:50.862238 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:36:50.862238 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:36:50.862238 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:36:50.862238 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:36:50.862238 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27322ac4-8704-4f1a-b431-e5c4ad7d77ad could not be found. May 28 17:36:50.862238 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:36:50.862238 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:36:50.862238 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:36:50.862238 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:36:50.862238 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:36:50.862238 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:36:50.862238 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:36:50.862238 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:36:50.862238 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:36:50.864728 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:36:50.864728 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:36:50.864728 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:36:50.864728 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:36:50.864728 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:36:50.864728 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:36:50.864728 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:36:50.864728 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27322ac4-8704-4f1a-b431-e5c4ad7d77ad could not be found. May 28 17:36:50.864728 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:36:50.864728 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:36:50.864728 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:36:50.864728 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:36:50.864728 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:36:50.864728 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:36:50.864728 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:36:50.864728 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:36:50.864728 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27322ac4-8704-4f1a-b431-e5c4ad7d77ad could not be found. May 28 17:36:50.864728 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:36:50.868282 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-80068854-de9c-4092-82cb-efda527df14b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Returning 404 to user: Instance 27322ac4-8704-4f1a-b431-e5c4ad7d77ad could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:36:50.870756 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-80068854-de9c-4092-82cb-efda527df14b tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 404 len: 111 microversion: 2.20 time: 0.042188 May 28 17:36:50.874810 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 529/1063] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:36:50 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 17:36:50.889643 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-cba5544c-5fb2-4b92-9cdf-9397436ea89c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '.version_select at 0x7f9eeffe6e50>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:36:50.914172 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-cba5544c-5fb2-4b92-9cdf-9397436ea89c tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1442268248" status: 204 len: 0 microversion: 2.20 time: 0.029969 May 28 17:36:50.915844 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 535/1064] 10.222.0.33 () {60 vars in 1261 bytes} [Sat May 28 17:36:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1442268248 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 17:36:53.343603 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3e719341-baba-4f50-918d-6a36a8a192c4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:36:53.344242 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3e719341-baba-4f50-918d-6a36a8a192c4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:36:53.351228 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3e719341-baba-4f50-918d-6a36a8a192c4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:53.351785 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3e719341-baba-4f50-918d-6a36a8a192c4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:53.352631 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3e719341-baba-4f50-918d-6a36a8a192c4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:53.353144 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3e719341-baba-4f50-918d-6a36a8a192c4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:53.372809 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-3e719341-baba-4f50-918d-6a36a8a192c4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] HTTP exception thrown: Instance 27322ac4-8704-4f1a-b431-e5c4ad7d77ad could not be found. May 28 17:36:53.374396 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3e719341-baba-4f50-918d-6a36a8a192c4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Request method failure captured: May 28 17:36:53.374396 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: request: DELETE /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad HTTP/1.1 May 28 17:36:53.374396 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept: application/json May 28 17:36:53.374396 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity May 28 17:36:53.374396 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Connection: close May 28 17:36:53.374396 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Length: 0 May 28 17:36:53.374396 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Type: application/json May 28 17:36:53.374396 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 May 28 17:36:53.374396 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None May 28 17:36:53.374396 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 May 28 17:36:53.374396 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABiklt0ryigSES2va0FJ5urnH-xGPHxC2ofGmHZJwTcOlD6rM0ANKwwYZPb96v1LqEjiGMXf0HExZtWCwjd26LOuC9S5qOYFPKmaY81VW-Iz8BFNQMQ1GSjg9MeNtwueDXFDFVLCzX8HxCa7EJe3Wbi5d9p8fynqoJNgd_K7l6YAFVc3Zk May 28 17:36:53.374396 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Id: None May 28 17:36:53.374396 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Name: None May 28 17:36:53.374396 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed May 28 17:36:53.374396 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True May 28 17:36:53.374396 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Openstack-Nova-Api-Version: 2.20 May 28 17:36:53.374396 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default May 28 17:36:53.374396 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default May 28 17:36:53.374396 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Id: afaaf8bde7134efc80c77d707bb309bc May 28 17:36:53.374396 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-730962505 May 28 17:36:53.374396 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Role: reader,member May 28 17:36:53.374396 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Roles: reader,member May 28 17:36:53.376013 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afaaf8bde7134efc80c77d707bb309bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afaaf8bde7134efc80c77d707bb309bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/afaaf8bde7134efc80c77d707bb309bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_afaaf8bde7134efc80c77d707bb309bc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:36:53.376013 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeShelveTestJSON-730962505 May 28 17:36:53.376013 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Id: afaaf8bde7134efc80c77d707bb309bc May 28 17:36:53.376013 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-730962505 May 28 17:36:53.376013 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeShelveTestJSON-730962505-project May 28 17:36:53.376013 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default May 28 17:36:53.376013 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default May 28 17:36:53.376013 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Id: 710b406ba65646ed94c3f9d356b161f1 May 28 17:36:53.376013 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeShelveTestJSON-730962505-project May 28 17:36:53.376013 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: method: > May 28 17:36:53.376013 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: exception: Instance 27322ac4-8704-4f1a-b431-e5c4ad7d77ad could not be found. May 28 17:36:53.376013 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: action_args: {'id': '27322ac4-8704-4f1a-b431-e5c4ad7d77ad'} May 28 17:36:53.376993 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:36:53.376993 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:36:53.376993 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:36:53.376993 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:36:53.376993 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:36:53.376993 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:36:53.376993 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:36:53.376993 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:36:53.376993 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:36:53.376993 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:36:53.376993 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27322ac4-8704-4f1a-b431-e5c4ad7d77ad could not be found. May 28 17:36:53.376993 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:36:53.376993 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:36:53.376993 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:36:53.376993 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:36:53.376993 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:36:53.376993 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:36:53.376993 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:36:53.376993 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:36:53.376993 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:36:53.379255 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:36:53.379255 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 17:36:53.379255 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 17:36:53.379255 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 17:36:53.379255 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 17:36:53.379255 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:36:53.379255 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:36:53.379255 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:36:53.379255 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:36:53.379255 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27322ac4-8704-4f1a-b431-e5c4ad7d77ad could not be found. May 28 17:36:53.379255 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:36:53.379255 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:36:53.379255 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:36:53.379255 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:36:53.379255 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:36:53.379255 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:36:53.379255 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:36:53.379255 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:36:53.379255 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27322ac4-8704-4f1a-b431-e5c4ad7d77ad could not be found. May 28 17:36:53.379255 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:36:53.381495 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3e719341-baba-4f50-918d-6a36a8a192c4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Returning 404 to user: Instance 27322ac4-8704-4f1a-b431-e5c4ad7d77ad could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:36:53.381495 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3e719341-baba-4f50-918d-6a36a8a192c4 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "DELETE /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 404 len: 111 microversion: 2.20 time: 0.036688 May 28 17:36:53.381495 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 530/1065] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 17:36:53 2022] DELETE /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 17:36:53.386444 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f1e52bc5-cce8-4fd4-a030-30fc008015e2 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:36:53.387427 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f1e52bc5-cce8-4fd4-a030-30fc008015e2 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 27322ac4-8704-4f1a-b431-e5c4ad7d77ad] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:36:53.395118 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f1e52bc5-cce8-4fd4-a030-30fc008015e2 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:53.395626 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f1e52bc5-cce8-4fd4-a030-30fc008015e2 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:53.396421 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f1e52bc5-cce8-4fd4-a030-30fc008015e2 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:53.396853 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f1e52bc5-cce8-4fd4-a030-30fc008015e2 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:53.411151 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-f1e52bc5-cce8-4fd4-a030-30fc008015e2 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] HTTP exception thrown: Instance 27322ac4-8704-4f1a-b431-e5c4ad7d77ad could not be found. May 28 17:36:53.412899 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f1e52bc5-cce8-4fd4-a030-30fc008015e2 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Request method failure captured: May 28 17:36:53.412899 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad HTTP/1.1 May 28 17:36:53.412899 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:36:53.412899 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:36:53.412899 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:36:53.412899 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 0 May 28 17:36:53.412899 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:36:53.412899 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:36:53.412899 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:36:53.412899 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:36:53.412899 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABiklt0ryigSES2va0FJ5urnH-xGPHxC2ofGmHZJwTcOlD6rM0ANKwwYZPb96v1LqEjiGMXf0HExZtWCwjd26LOuC9S5qOYFPKmaY81VW-Iz8BFNQMQ1GSjg9MeNtwueDXFDFVLCzX8HxCa7EJe3Wbi5d9p8fynqoJNgd_K7l6YAFVc3Zk May 28 17:36:53.412899 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:36:53.412899 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:36:53.412899 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:36:53.412899 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:36:53.412899 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Openstack-Nova-Api-Version: 2.20 May 28 17:36:53.412899 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:36:53.412899 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:36:53.412899 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: afaaf8bde7134efc80c77d707bb309bc May 28 17:36:53.412899 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-730962505 May 28 17:36:53.412899 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:36:53.412899 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:36:53.414658 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afaaf8bde7134efc80c77d707bb309bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afaaf8bde7134efc80c77d707bb309bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/afaaf8bde7134efc80c77d707bb309bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_afaaf8bde7134efc80c77d707bb309bc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:36:53.414658 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-AttachVolumeShelveTestJSON-730962505 May 28 17:36:53.414658 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: afaaf8bde7134efc80c77d707bb309bc May 28 17:36:53.414658 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-730962505 May 28 17:36:53.414658 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-AttachVolumeShelveTestJSON-730962505-project May 28 17:36:53.414658 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:36:53.414658 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:36:53.414658 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: 710b406ba65646ed94c3f9d356b161f1 May 28 17:36:53.414658 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-AttachVolumeShelveTestJSON-730962505-project May 28 17:36:53.414658 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: > May 28 17:36:53.414658 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Instance 27322ac4-8704-4f1a-b431-e5c4ad7d77ad could not be found. May 28 17:36:53.414658 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'id': '27322ac4-8704-4f1a-b431-e5c4ad7d77ad'} May 28 17:36:53.415621 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:36:53.415621 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:36:53.415621 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:36:53.415621 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:36:53.415621 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:36:53.415621 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:36:53.415621 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:36:53.415621 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:36:53.415621 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:36:53.415621 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:36:53.415621 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27322ac4-8704-4f1a-b431-e5c4ad7d77ad could not be found. May 28 17:36:53.415621 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:36:53.415621 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:36:53.415621 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:36:53.415621 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:36:53.415621 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:36:53.415621 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:36:53.415621 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:36:53.415621 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:36:53.415621 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:36:53.417176 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:36:53.417176 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:36:53.417176 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:36:53.417176 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:36:53.417176 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:36:53.417176 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:36:53.417176 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:36:53.417176 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27322ac4-8704-4f1a-b431-e5c4ad7d77ad could not be found. May 28 17:36:53.417176 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:36:53.417176 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:36:53.417176 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:36:53.417176 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:36:53.417176 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:36:53.417176 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:36:53.417176 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:36:53.417176 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:36:53.417176 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27322ac4-8704-4f1a-b431-e5c4ad7d77ad could not be found. May 28 17:36:53.417176 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:36:53.418514 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f1e52bc5-cce8-4fd4-a030-30fc008015e2 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Returning 404 to user: Instance 27322ac4-8704-4f1a-b431-e5c4ad7d77ad could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:36:53.418514 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f1e52bc5-cce8-4fd4-a030-30fc008015e2 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad" status: 404 len: 111 microversion: 2.20 time: 0.031988 May 28 17:36:53.421173 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 536/1066] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:36:53 2022] GET /compute/v2.1/servers/27322ac4-8704-4f1a-b431-e5c4ad7d77ad => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 17:36:54.588413 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-611e6687-39c6-447e-bbd8-66d6b0a48539 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:36:54.589613 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-611e6687-39c6-447e-bbd8-66d6b0a48539 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:36:54.597599 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-611e6687-39c6-447e-bbd8-66d6b0a48539 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:54.598172 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-611e6687-39c6-447e-bbd8-66d6b0a48539 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:54.598961 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-611e6687-39c6-447e-bbd8-66d6b0a48539 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:54.599438 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-611e6687-39c6-447e-bbd8-66d6b0a48539 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:54.615990 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-611e6687-39c6-447e-bbd8-66d6b0a48539 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] HTTP exception thrown: Instance 1e52b200-7c75-45f2-92ed-813b306fc334 could not be found. May 28 17:36:54.618259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-611e6687-39c6-447e-bbd8-66d6b0a48539 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Request method failure captured: May 28 17:36:54.618259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: request: DELETE /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 HTTP/1.1 May 28 17:36:54.618259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept: application/json May 28 17:36:54.618259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity May 28 17:36:54.618259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Connection: close May 28 17:36:54.618259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Length: 0 May 28 17:36:54.618259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Type: application/json May 28 17:36:54.618259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 May 28 17:36:54.618259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None May 28 17:36:54.618259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 May 28 17:36:54.618259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABiklt0ryigSES2va0FJ5urnH-xGPHxC2ofGmHZJwTcOlD6rM0ANKwwYZPb96v1LqEjiGMXf0HExZtWCwjd26LOuC9S5qOYFPKmaY81VW-Iz8BFNQMQ1GSjg9MeNtwueDXFDFVLCzX8HxCa7EJe3Wbi5d9p8fynqoJNgd_K7l6YAFVc3Zk May 28 17:36:54.618259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Id: None May 28 17:36:54.618259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Name: None May 28 17:36:54.618259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed May 28 17:36:54.618259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True May 28 17:36:54.618259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Openstack-Nova-Api-Version: 2.20 May 28 17:36:54.618259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default May 28 17:36:54.618259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default May 28 17:36:54.618259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Id: afaaf8bde7134efc80c77d707bb309bc May 28 17:36:54.618259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-730962505 May 28 17:36:54.618259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Role: reader,member May 28 17:36:54.618259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Roles: reader,member May 28 17:36:54.619832 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afaaf8bde7134efc80c77d707bb309bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afaaf8bde7134efc80c77d707bb309bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/afaaf8bde7134efc80c77d707bb309bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_afaaf8bde7134efc80c77d707bb309bc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:36:54.619832 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeShelveTestJSON-730962505 May 28 17:36:54.619832 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Id: afaaf8bde7134efc80c77d707bb309bc May 28 17:36:54.619832 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-730962505 May 28 17:36:54.619832 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeShelveTestJSON-730962505-project May 28 17:36:54.619832 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default May 28 17:36:54.619832 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default May 28 17:36:54.619832 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Id: 710b406ba65646ed94c3f9d356b161f1 May 28 17:36:54.619832 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeShelveTestJSON-730962505-project May 28 17:36:54.619832 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: method: > May 28 17:36:54.619832 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: exception: Instance 1e52b200-7c75-45f2-92ed-813b306fc334 could not be found. May 28 17:36:54.619832 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: action_args: {'id': '1e52b200-7c75-45f2-92ed-813b306fc334'} May 28 17:36:54.620698 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:36:54.620698 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:36:54.620698 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:36:54.620698 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:36:54.620698 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:36:54.620698 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:36:54.620698 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:36:54.620698 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:36:54.620698 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:36:54.620698 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:36:54.620698 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e52b200-7c75-45f2-92ed-813b306fc334 could not be found. May 28 17:36:54.620698 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:36:54.620698 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:36:54.620698 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:36:54.620698 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:36:54.620698 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:36:54.620698 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:36:54.620698 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:36:54.620698 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:36:54.620698 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:36:54.622157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:36:54.622157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 17:36:54.622157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 17:36:54.622157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 17:36:54.622157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 17:36:54.622157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:36:54.622157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:36:54.622157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:36:54.622157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:36:54.622157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e52b200-7c75-45f2-92ed-813b306fc334 could not be found. May 28 17:36:54.622157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:36:54.622157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:36:54.622157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:36:54.622157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:36:54.622157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:36:54.622157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:36:54.622157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:36:54.622157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:36:54.622157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e52b200-7c75-45f2-92ed-813b306fc334 could not be found. May 28 17:36:54.622157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:36:54.625282 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-611e6687-39c6-447e-bbd8-66d6b0a48539 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Returning 404 to user: Instance 1e52b200-7c75-45f2-92ed-813b306fc334 could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:36:54.626436 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-611e6687-39c6-447e-bbd8-66d6b0a48539 tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 404 len: 111 microversion: 2.20 time: 0.045262 May 28 17:36:54.627087 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 531/1067] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 17:36:54 2022] DELETE /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 17:36:54.636417 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b721d77e-a4dd-4b3b-9936-a781232caedf tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:36:54.637237 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b721d77e-a4dd-4b3b-9936-a781232caedf tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] [instance: 1e52b200-7c75-45f2-92ed-813b306fc334] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:36:54.649005 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b721d77e-a4dd-4b3b-9936-a781232caedf tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:54.649736 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b721d77e-a4dd-4b3b-9936-a781232caedf tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:54.650716 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b721d77e-a4dd-4b3b-9936-a781232caedf tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:36:54.651368 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b721d77e-a4dd-4b3b-9936-a781232caedf tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:36:54.666197 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-b721d77e-a4dd-4b3b-9936-a781232caedf tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] HTTP exception thrown: Instance 1e52b200-7c75-45f2-92ed-813b306fc334 could not be found. May 28 17:36:54.668099 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b721d77e-a4dd-4b3b-9936-a781232caedf tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Request method failure captured: May 28 17:36:54.668099 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 HTTP/1.1 May 28 17:36:54.668099 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:36:54.668099 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:36:54.668099 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:36:54.668099 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 0 May 28 17:36:54.668099 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:36:54.668099 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:36:54.668099 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:36:54.668099 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:36:54.668099 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABiklt0ryigSES2va0FJ5urnH-xGPHxC2ofGmHZJwTcOlD6rM0ANKwwYZPb96v1LqEjiGMXf0HExZtWCwjd26LOuC9S5qOYFPKmaY81VW-Iz8BFNQMQ1GSjg9MeNtwueDXFDFVLCzX8HxCa7EJe3Wbi5d9p8fynqoJNgd_K7l6YAFVc3Zk May 28 17:36:54.668099 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:36:54.668099 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:36:54.668099 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:36:54.668099 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:36:54.668099 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Openstack-Nova-Api-Version: 2.20 May 28 17:36:54.668099 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:36:54.668099 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:36:54.668099 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: afaaf8bde7134efc80c77d707bb309bc May 28 17:36:54.668099 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-730962505 May 28 17:36:54.668099 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:36:54.668099 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:36:54.669796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afaaf8bde7134efc80c77d707bb309bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/afaaf8bde7134efc80c77d707bb309bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/afaaf8bde7134efc80c77d707bb309bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_afaaf8bde7134efc80c77d707bb309bc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:36:54.669796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-AttachVolumeShelveTestJSON-730962505 May 28 17:36:54.669796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: afaaf8bde7134efc80c77d707bb309bc May 28 17:36:54.669796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-730962505 May 28 17:36:54.669796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-AttachVolumeShelveTestJSON-730962505-project May 28 17:36:54.669796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:36:54.669796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:36:54.669796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: 710b406ba65646ed94c3f9d356b161f1 May 28 17:36:54.669796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-AttachVolumeShelveTestJSON-730962505-project May 28 17:36:54.669796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: > May 28 17:36:54.669796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Instance 1e52b200-7c75-45f2-92ed-813b306fc334 could not be found. May 28 17:36:54.669796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'id': '1e52b200-7c75-45f2-92ed-813b306fc334'} May 28 17:36:54.670911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:36:54.670911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:36:54.670911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:36:54.670911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:36:54.670911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:36:54.670911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:36:54.670911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:36:54.670911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:36:54.670911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:36:54.670911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:36:54.670911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e52b200-7c75-45f2-92ed-813b306fc334 could not be found. May 28 17:36:54.670911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:36:54.670911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:36:54.670911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:36:54.670911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:36:54.670911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:36:54.670911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:36:54.670911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:36:54.670911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:36:54.670911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:36:54.672447 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:36:54.672447 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:36:54.672447 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:36:54.672447 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:36:54.672447 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:36:54.672447 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:36:54.672447 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:36:54.672447 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e52b200-7c75-45f2-92ed-813b306fc334 could not be found. May 28 17:36:54.672447 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:36:54.672447 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:36:54.672447 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:36:54.672447 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:36:54.672447 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:36:54.672447 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:36:54.672447 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:36:54.672447 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:36:54.672447 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e52b200-7c75-45f2-92ed-813b306fc334 could not be found. May 28 17:36:54.672447 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:36:54.673961 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b721d77e-a4dd-4b3b-9936-a781232caedf tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] Returning 404 to user: Instance 1e52b200-7c75-45f2-92ed-813b306fc334 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:36:54.673961 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b721d77e-a4dd-4b3b-9936-a781232caedf tempest-AttachVolumeShelveTestJSON-730962505 tempest-AttachVolumeShelveTestJSON-730962505-project] 10.222.0.33 "GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334" status: 404 len: 111 microversion: 2.20 time: 0.037625 May 28 17:36:54.673961 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 537/1068] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 17:36:54 2022] GET /compute/v2.1/servers/1e52b200-7c75-45f2-92ed-813b306fc334 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 28 17:37:10.177129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 17:37:10.177616 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Sat May 28 17:37:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 17:37:20.554500 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1990a330-72a8-41d3-989d-8b19ca02b47e tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2069939905", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1169689163", "security_groups": [{"name": "tempest-secgroup-smoke-1697074357"}], "block_device_mapping_v2": [{"uuid": "ae2cbe57-b91a-4a57-9442-4d8dbf6464a6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a98bf986-b097-428c-84c6-2a59a4df1a9f"}]}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:37:20.564250 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=16 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:37:20.565382 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=32 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:37:20.684519 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.network.neutron [None req-1990a330-72a8-41d3-989d-8b19ca02b47e tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] validate_networks() for [('a98bf986-b097-428c-84c6-2a59a4df1a9f', None, None, None, None, None)] {{(pid=117605) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 17:37:21.192838 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-1990a330-72a8-41d3-989d-8b19ca02b47e tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Flavor limits 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 17:37:21.193211 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-1990a330-72a8-41d3-989d-8b19ca02b47e tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Image limits 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 17:37:21.193696 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-1990a330-72a8-41d3-989d-8b19ca02b47e tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Flavor pref 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 17:37:21.194132 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-1990a330-72a8-41d3-989d-8b19ca02b47e tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Image pref 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 17:37:21.194551 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-1990a330-72a8-41d3-989d-8b19ca02b47e tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 17:37:21.203734 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1990a330-72a8-41d3-989d-8b19ca02b47e tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:21.204293 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1990a330-72a8-41d3-989d-8b19ca02b47e tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:21.205283 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1990a330-72a8-41d3-989d-8b19ca02b47e tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:21.205758 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1990a330-72a8-41d3-989d-8b19ca02b47e tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:21.223644 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-1990a330-72a8-41d3-989d-8b19ca02b47e tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Getting quotas for project 3785f78e6d1048cfa0b5b123fdd909c8. Resources: {'instances', 'cores', 'ram'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:37:21.227973 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-1990a330-72a8-41d3-989d-8b19ca02b47e tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Getting quotas for user 4a827bedc4b84508bb7770a09efee3f5 and project 3785f78e6d1048cfa0b5b123fdd909c8. Resources: {'instances', 'cores', 'ram'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:37:21.287998 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1990a330-72a8-41d3-989d-8b19ca02b47e tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Going to run 1 instances... {{(pid=117605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 17:37:21.290155 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1990a330-72a8-41d3-989d-8b19ca02b47e tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ae2cbe57-b91a-4a57-9442-4d8dbf6464a6',volume_size=None,volume_type=None)] {{(pid=117605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 17:37:21.430198 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1990a330-72a8-41d3-989d-8b19ca02b47e tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.879647 May 28 17:37:21.430845 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 532/1069] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 17:37:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 17:37:21.441417 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f520eed2-4168-44ee-8385-31caca80856f tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:21.442149 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f520eed2-4168-44ee-8385-31caca80856f tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:21.447685 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=4 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:37:21.448633 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:37:21.449217 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:37:21.523033 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f520eed2-4168-44ee-8385-31caca80856f tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:21.530186 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f520eed2-4168-44ee-8385-31caca80856f tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 200 len: 1095 microversion: 2.1 time: 0.093224 May 28 17:37:21.530754 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 538/1070] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:21 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 1095 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:22.548535 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c117bb90-2d0d-4015-9a82-256f8e1645e3 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:22.549161 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c117bb90-2d0d-4015-9a82-256f8e1645e3 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:22.557567 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c117bb90-2d0d-4015-9a82-256f8e1645e3 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:22.558184 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c117bb90-2d0d-4015-9a82-256f8e1645e3 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:22.559208 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c117bb90-2d0d-4015-9a82-256f8e1645e3 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:22.559793 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c117bb90-2d0d-4015-9a82-256f8e1645e3 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:22.630573 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c117bb90-2d0d-4015-9a82-256f8e1645e3 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:22.637144 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c117bb90-2d0d-4015-9a82-256f8e1645e3 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 200 len: 1193 microversion: 2.1 time: 0.093112 May 28 17:37:22.637803 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 533/1071] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:22 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 1193 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:23.658863 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8425f621-99c6-42f2-91f2-2d60db325633 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:23.661505 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8425f621-99c6-42f2-91f2-2d60db325633 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:23.675975 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8425f621-99c6-42f2-91f2-2d60db325633 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:23.676926 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8425f621-99c6-42f2-91f2-2d60db325633 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:23.678443 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8425f621-99c6-42f2-91f2-2d60db325633 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:23.679595 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8425f621-99c6-42f2-91f2-2d60db325633 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:23.901318 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8425f621-99c6-42f2-91f2-2d60db325633 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:23.910301 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8425f621-99c6-42f2-91f2-2d60db325633 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 200 len: 1279 microversion: 2.1 time: 0.258921 May 28 17:37:23.911785 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 539/1072] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:23 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 1279 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:24.414975 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-7b57a37b-1ca8-4e4b-b55b-7e202c39440b req-53b14559-4c8e-48e1-991a-4b86d08587b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03b782e2-0501-4467-9b07-0a0766795ad4", "tag": "e8ae62d4-a8b6-4a83-8ce0-f58a2953d5ca"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:37:24.429129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-7b57a37b-1ca8-4e4b-b55b-7e202c39440b req-53b14559-4c8e-48e1-991a-4b86d08587b4 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:24.429572 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-7b57a37b-1ca8-4e4b-b55b-7e202c39440b req-53b14559-4c8e-48e1-991a-4b86d08587b4 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:24.445094 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-7b57a37b-1ca8-4e4b-b55b-7e202c39440b req-53b14559-4c8e-48e1-991a-4b86d08587b4 service nova] Creating event network-changed:e8ae62d4-a8b6-4a83-8ce0-f58a2953d5ca for instance 03b782e2-0501-4467-9b07-0a0766795ad4 on hv-cinder-84372 May 28 17:37:24.450836 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-7b57a37b-1ca8-4e4b-b55b-7e202c39440b req-53b14559-4c8e-48e1-991a-4b86d08587b4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039425 May 28 17:37:24.451847 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 534/1073] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:37:24.929968 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3bcf78b8-8a28-40f4-98f9-5c9204622b2b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:24.930585 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3bcf78b8-8a28-40f4-98f9-5c9204622b2b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:24.937161 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3bcf78b8-8a28-40f4-98f9-5c9204622b2b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:24.937610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3bcf78b8-8a28-40f4-98f9-5c9204622b2b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:24.938372 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3bcf78b8-8a28-40f4-98f9-5c9204622b2b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:24.938808 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3bcf78b8-8a28-40f4-98f9-5c9204622b2b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:25.078327 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-3bcf78b8-8a28-40f4-98f9-5c9204622b2b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:25.087209 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3bcf78b8-8a28-40f4-98f9-5c9204622b2b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 200 len: 1267 microversion: 2.1 time: 0.161039 May 28 17:37:25.087847 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 540/1074] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:24 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:26.106098 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-73410077-3911-4151-8377-df2fc374913c tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:26.106793 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-73410077-3911-4151-8377-df2fc374913c tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:26.113569 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-73410077-3911-4151-8377-df2fc374913c tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:26.114019 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-73410077-3911-4151-8377-df2fc374913c tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:26.114778 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-73410077-3911-4151-8377-df2fc374913c tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:26.115215 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-73410077-3911-4151-8377-df2fc374913c tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:26.258134 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-73410077-3911-4151-8377-df2fc374913c tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:26.265464 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-73410077-3911-4151-8377-df2fc374913c tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 200 len: 1267 microversion: 2.1 time: 0.164176 May 28 17:37:26.266019 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 535/1075] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:26 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:37:27.281866 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3c8cb455-e0d3-4a24-9486-5111f9a70b7a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:27.282476 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3c8cb455-e0d3-4a24-9486-5111f9a70b7a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:27.290375 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3c8cb455-e0d3-4a24-9486-5111f9a70b7a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:27.290824 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3c8cb455-e0d3-4a24-9486-5111f9a70b7a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:27.291612 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3c8cb455-e0d3-4a24-9486-5111f9a70b7a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:27.292045 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3c8cb455-e0d3-4a24-9486-5111f9a70b7a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:27.426608 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-3c8cb455-e0d3-4a24-9486-5111f9a70b7a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:27.434693 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3c8cb455-e0d3-4a24-9486-5111f9a70b7a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 200 len: 1267 microversion: 2.1 time: 0.156576 May 28 17:37:27.435266 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 541/1076] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:27 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:28.451690 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-67879921-9ae7-4a2b-a738-55f06c8029de tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:28.452309 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-67879921-9ae7-4a2b-a738-55f06c8029de tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:28.460273 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-67879921-9ae7-4a2b-a738-55f06c8029de tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:28.460729 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-67879921-9ae7-4a2b-a738-55f06c8029de tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:28.461782 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-67879921-9ae7-4a2b-a738-55f06c8029de tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:28.462503 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-67879921-9ae7-4a2b-a738-55f06c8029de tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:28.601830 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-67879921-9ae7-4a2b-a738-55f06c8029de tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:28.609470 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-67879921-9ae7-4a2b-a738-55f06c8029de tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 200 len: 1267 microversion: 2.1 time: 0.161813 May 28 17:37:28.610041 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 536/1077] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:28 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:29.626995 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b342f7a3-2567-4990-aa21-c52eb065b88a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:29.628827 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b342f7a3-2567-4990-aa21-c52eb065b88a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:29.635923 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b342f7a3-2567-4990-aa21-c52eb065b88a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:29.636369 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b342f7a3-2567-4990-aa21-c52eb065b88a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:29.637128 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b342f7a3-2567-4990-aa21-c52eb065b88a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:29.637559 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b342f7a3-2567-4990-aa21-c52eb065b88a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:29.778968 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b342f7a3-2567-4990-aa21-c52eb065b88a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:29.787085 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b342f7a3-2567-4990-aa21-c52eb065b88a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 200 len: 1267 microversion: 2.1 time: 0.163834 May 28 17:37:29.787918 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 542/1078] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:29 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:29.878911 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-298f4c44-85c5-422f-971c-e76de36bd4e8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:29.879559 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-298f4c44-85c5-422f-971c-e76de36bd4e8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:29.889031 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-298f4c44-85c5-422f-971c-e76de36bd4e8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:29.889553 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-298f4c44-85c5-422f-971c-e76de36bd4e8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:29.890388 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-298f4c44-85c5-422f-971c-e76de36bd4e8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:29.890894 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-298f4c44-85c5-422f-971c-e76de36bd4e8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:29.916333 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-298f4c44-85c5-422f-971c-e76de36bd4e8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d/ips" status: 200 len: 149 microversion: 2.1 time: 0.041767 May 28 17:37:29.916912 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 537/1079] 10.222.0.33 () {58 vars in 1247 bytes} [Sat May 28 17:37:29 2022] GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:37:29.928355 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0273ec22-a9fa-45b5-a3ad-63c1ac4901c3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "889cc987-3bbb-4b93-903c-7dcfb2541d55"}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:37:29.929616 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0273ec22-a9fa-45b5-a3ad-63c1ac4901c3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:29.936532 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0273ec22-a9fa-45b5-a3ad-63c1ac4901c3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:29.937110 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0273ec22-a9fa-45b5-a3ad-63c1ac4901c3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:29.938114 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0273ec22-a9fa-45b5-a3ad-63c1ac4901c3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:29.938559 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0273ec22-a9fa-45b5-a3ad-63c1ac4901c3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:30.023683 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-0273ec22-a9fa-45b5-a3ad-63c1ac4901c3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] HTTP exception thrown: Invalid volume: volume 889cc987-3bbb-4b93-903c-7dcfb2541d55 is already attached to instances: 6863e51f-850f-4d83-a5ea-34408f176184 May 28 17:37:30.025307 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0273ec22-a9fa-45b5-a3ad-63c1ac4901c3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Request method failure captured: May 28 17:37:30.025307 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: POST /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d/os-volume_attachments HTTP/1.1 May 28 17:37:30.025307 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:37:30.025307 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:37:30.025307 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:37:30.025307 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 74 May 28 17:37:30.025307 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:37:30.025307 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:37:30.025307 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:37:30.025307 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:37:30.025307 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABiklztpzsrcs87QXRJpScgk-5tUukjwPy1pG5nwYCeqw-1TdfbNHEPQv0dxfORMmAI_huWNfz4S1kkPQDKvHAPGaV0itPNNhduphbnIQQ9CdIotGmgnrod8uAS5LCp8f9bs3_RlkUgWcVbaRmZwj6AERxTjQmBOF2VAsv1p_k3m3IU8vI May 28 17:37:30.025307 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:37:30.025307 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:37:30.025307 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:37:30.025307 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:37:30.025307 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:37:30.025307 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:37:30.025307 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: 9525b35792a04dc3a6f109cb39ee9d50 May 28 17:37:30.025307 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:37:30.025307 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:37:30.025307 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:37:30.026882 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9525b35792a04dc3a6f109cb39ee9d50", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:37:30.026882 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:37:30.026882 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 9525b35792a04dc3a6f109cb39ee9d50 May 28 17:37:30.026882 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:37:30.026882 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-AttachVolumeNegativeTest-1796155594-project May 28 17:37:30.026882 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:37:30.026882 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:37:30.026882 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: 7343386004e24474bc0af9126f47182b May 28 17:37:30.026882 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-AttachVolumeNegativeTest-1796155594-project May 28 17:37:30.026882 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: May 28 17:37:30.026882 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {"volumeAttachment": {"volumeId": "889cc987-3bbb-4b93-903c-7dcfb2541d55"}} May 28 17:37:30.026882 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: > May 28 17:37:30.031140 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Invalid volume: volume 889cc987-3bbb-4b93-903c-7dcfb2541d55 is already attached to instances: 6863e51f-850f-4d83-a5ea-34408f176184 May 28 17:37:30.031140 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'server_id': '9a72ea47-a87d-4716-981b-423fe0a0d60d', 'body': {'volumeAttachment': {'volumeId': '889cc987-3bbb-4b93-903c-7dcfb2541d55'}}} May 28 17:37:30.031140 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:37:30.031140 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:37:30.031140 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 28 17:37:30.031140 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 28 17:37:30.031140 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 17:37:30.031140 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 17:37:30.031140 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 28 17:37:30.031140 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 17:37:30.031140 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 28 17:37:30.031140 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 28 17:37:30.031140 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 28 17:37:30.031140 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 28 17:37:30.031140 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 889cc987-3bbb-4b93-903c-7dcfb2541d55 is already attached to instances: 6863e51f-850f-4d83-a5ea-34408f176184 May 28 17:37:30.031140 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:37:30.031140 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:37:30.031140 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:37:30.031140 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:37:30.032646 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:37:30.032646 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:37:30.032646 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:37:30.032646 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:37:30.032646 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:37:30.032646 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:37:30.032646 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 17:37:30.032646 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 17:37:30.032646 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 17:37:30.032646 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 17:37:30.032646 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 17:37:30.032646 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 17:37:30.032646 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 28 17:37:30.032646 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 28 17:37:30.032646 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 889cc987-3bbb-4b93-903c-7dcfb2541d55 is already attached to instances: 6863e51f-850f-4d83-a5ea-34408f176184 May 28 17:37:30.032646 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:37:30.032646 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:37:30.032646 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:37:30.032646 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:37:30.032646 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:37:30.034766 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:37:30.034766 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:37:30.034766 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:37:30.034766 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 889cc987-3bbb-4b93-903c-7dcfb2541d55 is already attached to instances: 6863e51f-850f-4d83-a5ea-34408f176184 May 28 17:37:30.034766 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:37:30.034766 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0273ec22-a9fa-45b5-a3ad-63c1ac4901c3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Returning 400 to user: Invalid volume: volume 889cc987-3bbb-4b93-903c-7dcfb2541d55 is already attached to instances: 6863e51f-850f-4d83-a5ea-34408f176184 {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:37:30.034766 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0273ec22-a9fa-45b5-a3ad-63c1ac4901c3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "POST /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103683 May 28 17:37:30.034766 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 543/1080] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 17:37:29 2022] POST /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 17:37:30.036805 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a18d2f19-9ff2-424f-af01-99aee04e5255 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:30.037387 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a18d2f19-9ff2-424f-af01-99aee04e5255 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:30.043683 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a18d2f19-9ff2-424f-af01-99aee04e5255 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:30.044133 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a18d2f19-9ff2-424f-af01-99aee04e5255 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:30.044875 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a18d2f19-9ff2-424f-af01-99aee04e5255 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:30.045295 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a18d2f19-9ff2-424f-af01-99aee04e5255 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:30.073156 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a18d2f19-9ff2-424f-af01-99aee04e5255 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Going to try to terminate instance {{(pid=117605) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 17:37:30.179003 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a18d2f19-9ff2-424f-af01-99aee04e5255 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d" status: 204 len: 0 microversion: 2.1 time: 0.146280 May 28 17:37:30.179895 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 538/1081] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 17:37:30 2022] DELETE /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 17:37:30.189421 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ebde880b-7dd4-4deb-8582-334f07b3c37a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:30.191007 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ebde880b-7dd4-4deb-8582-334f07b3c37a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:30.203581 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ebde880b-7dd4-4deb-8582-334f07b3c37a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:30.204402 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ebde880b-7dd4-4deb-8582-334f07b3c37a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:30.206483 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ebde880b-7dd4-4deb-8582-334f07b3c37a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:30.207363 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ebde880b-7dd4-4deb-8582-334f07b3c37a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:30.354685 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ebde880b-7dd4-4deb-8582-334f07b3c37a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:30.362962 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ebde880b-7dd4-4deb-8582-334f07b3c37a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d" status: 200 len: 1681 microversion: 2.1 time: 0.178307 May 28 17:37:30.363773 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 544/1082] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:30 2022] GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:30.805035 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9ce054b3-139b-4fc5-8bdf-8533065bcb09 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:30.805762 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9ce054b3-139b-4fc5-8bdf-8533065bcb09 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:30.812407 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9ce054b3-139b-4fc5-8bdf-8533065bcb09 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:30.812879 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9ce054b3-139b-4fc5-8bdf-8533065bcb09 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:30.813689 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9ce054b3-139b-4fc5-8bdf-8533065bcb09 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:30.814159 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9ce054b3-139b-4fc5-8bdf-8533065bcb09 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:30.952043 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-9ce054b3-139b-4fc5-8bdf-8533065bcb09 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:30.960240 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9ce054b3-139b-4fc5-8bdf-8533065bcb09 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 200 len: 1267 microversion: 2.1 time: 0.159372 May 28 17:37:30.960888 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 539/1083] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:30 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:31.381939 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-528a439e-859c-4ffa-9c63-3cf63d0bac78 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:31.382560 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-528a439e-859c-4ffa-9c63-3cf63d0bac78 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:31.389327 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-528a439e-859c-4ffa-9c63-3cf63d0bac78 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:31.389760 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-528a439e-859c-4ffa-9c63-3cf63d0bac78 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:31.390522 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-528a439e-859c-4ffa-9c63-3cf63d0bac78 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:31.390958 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-528a439e-859c-4ffa-9c63-3cf63d0bac78 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:31.529927 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:37:31.554795 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-528a439e-859c-4ffa-9c63-3cf63d0bac78 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:31.562298 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-528a439e-859c-4ffa-9c63-3cf63d0bac78 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d" status: 200 len: 1681 microversion: 2.1 time: 0.185185 May 28 17:37:31.562857 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 545/1084] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:31 2022] GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d => generated 1681 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:31.977816 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f50bd1ae-dcf2-4e4c-8347-a110d977b6c6 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:31.978496 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f50bd1ae-dcf2-4e4c-8347-a110d977b6c6 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:31.980712 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=2 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:37:31.981463 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=6 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:37:31.989050 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f50bd1ae-dcf2-4e4c-8347-a110d977b6c6 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:31.989504 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f50bd1ae-dcf2-4e4c-8347-a110d977b6c6 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:31.990276 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f50bd1ae-dcf2-4e4c-8347-a110d977b6c6 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:31.990718 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f50bd1ae-dcf2-4e4c-8347-a110d977b6c6 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:32.117487 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f50bd1ae-dcf2-4e4c-8347-a110d977b6c6 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:32.124912 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f50bd1ae-dcf2-4e4c-8347-a110d977b6c6 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 200 len: 1267 microversion: 2.1 time: 0.151735 May 28 17:37:32.125475 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 540/1085] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:31 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:32.579566 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5ac6a231-340c-4b36-a3cb-9255c5b16451 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:32.580683 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5ac6a231-340c-4b36-a3cb-9255c5b16451 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:32.588007 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5ac6a231-340c-4b36-a3cb-9255c5b16451 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:32.588573 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5ac6a231-340c-4b36-a3cb-9255c5b16451 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:32.589464 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5ac6a231-340c-4b36-a3cb-9255c5b16451 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:32.589969 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5ac6a231-340c-4b36-a3cb-9255c5b16451 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:32.722833 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5ac6a231-340c-4b36-a3cb-9255c5b16451 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:32.730366 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5ac6a231-340c-4b36-a3cb-9255c5b16451 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d" status: 200 len: 1681 microversion: 2.1 time: 0.154724 May 28 17:37:32.730924 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 546/1086] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:32 2022] GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:37:33.141904 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-6bc5bf82-9cb8-4f7c-90a7-eafca2235071 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:33.142521 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-6bc5bf82-9cb8-4f7c-90a7-eafca2235071 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:33.149764 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6bc5bf82-9cb8-4f7c-90a7-eafca2235071 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:33.150207 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6bc5bf82-9cb8-4f7c-90a7-eafca2235071 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:33.150957 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6bc5bf82-9cb8-4f7c-90a7-eafca2235071 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:33.151409 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-6bc5bf82-9cb8-4f7c-90a7-eafca2235071 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:33.282360 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-6bc5bf82-9cb8-4f7c-90a7-eafca2235071 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:33.289888 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-6bc5bf82-9cb8-4f7c-90a7-eafca2235071 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 200 len: 1267 microversion: 2.1 time: 0.151798 May 28 17:37:33.290453 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 541/1087] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:33 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:33.747703 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6f66579d-0877-4960-a19b-8d3782aa35ec tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:33.748318 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6f66579d-0877-4960-a19b-8d3782aa35ec tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:33.755087 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6f66579d-0877-4960-a19b-8d3782aa35ec tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:33.755562 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6f66579d-0877-4960-a19b-8d3782aa35ec tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:33.756314 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6f66579d-0877-4960-a19b-8d3782aa35ec tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:33.756742 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6f66579d-0877-4960-a19b-8d3782aa35ec tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:33.883315 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6f66579d-0877-4960-a19b-8d3782aa35ec tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:33.890803 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6f66579d-0877-4960-a19b-8d3782aa35ec tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d" status: 200 len: 1681 microversion: 2.1 time: 0.146971 May 28 17:37:33.891379 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 547/1088] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:33 2022] GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:34.306218 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4deed0b4-684f-4304-a2bc-a0cb71ba0c40 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:34.306811 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4deed0b4-684f-4304-a2bc-a0cb71ba0c40 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:34.313179 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4deed0b4-684f-4304-a2bc-a0cb71ba0c40 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:34.313629 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4deed0b4-684f-4304-a2bc-a0cb71ba0c40 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:34.314481 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4deed0b4-684f-4304-a2bc-a0cb71ba0c40 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:34.315677 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4deed0b4-684f-4304-a2bc-a0cb71ba0c40 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:34.444895 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-4deed0b4-684f-4304-a2bc-a0cb71ba0c40 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:34.452280 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4deed0b4-684f-4304-a2bc-a0cb71ba0c40 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 200 len: 1267 microversion: 2.1 time: 0.149956 May 28 17:37:34.452840 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 542/1089] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:34 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:34.908667 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-528867c6-d58e-458d-8c6d-1a3d1715878d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:34.909314 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-528867c6-d58e-458d-8c6d-1a3d1715878d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:34.916154 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-528867c6-d58e-458d-8c6d-1a3d1715878d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:34.916604 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-528867c6-d58e-458d-8c6d-1a3d1715878d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:34.917362 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-528867c6-d58e-458d-8c6d-1a3d1715878d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:34.917848 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-528867c6-d58e-458d-8c6d-1a3d1715878d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:35.046306 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-528867c6-d58e-458d-8c6d-1a3d1715878d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:35.054355 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-528867c6-d58e-458d-8c6d-1a3d1715878d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d" status: 200 len: 1681 microversion: 2.1 time: 0.149931 May 28 17:37:35.054914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 548/1090] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:34 2022] GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:35.470124 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e6b569a5-6aab-4418-b128-aa966ae2c632 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:35.470743 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-e6b569a5-6aab-4418-b128-aa966ae2c632 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:35.477741 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e6b569a5-6aab-4418-b128-aa966ae2c632 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:35.478194 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e6b569a5-6aab-4418-b128-aa966ae2c632 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:35.478956 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e6b569a5-6aab-4418-b128-aa966ae2c632 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:35.479417 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e6b569a5-6aab-4418-b128-aa966ae2c632 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:35.614053 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-e6b569a5-6aab-4418-b128-aa966ae2c632 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:35.621736 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-e6b569a5-6aab-4418-b128-aa966ae2c632 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 200 len: 1267 microversion: 2.1 time: 0.155596 May 28 17:37:35.622363 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 543/1091] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:35 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:36.080108 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-7aa9829c-0916-4e1c-b6db-95d769af932f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:36.080992 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-7aa9829c-0916-4e1c-b6db-95d769af932f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:36.089506 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7aa9829c-0916-4e1c-b6db-95d769af932f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:36.090266 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7aa9829c-0916-4e1c-b6db-95d769af932f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:36.091425 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7aa9829c-0916-4e1c-b6db-95d769af932f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:36.092133 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7aa9829c-0916-4e1c-b6db-95d769af932f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:36.242526 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7aa9829c-0916-4e1c-b6db-95d769af932f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:36.249938 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-7aa9829c-0916-4e1c-b6db-95d769af932f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d" status: 200 len: 1681 microversion: 2.1 time: 0.177607 May 28 17:37:36.250504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 549/1092] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:36 2022] GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:36.639301 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-080875b7-a466-4bae-9581-213cabd96e15 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:36.639871 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-080875b7-a466-4bae-9581-213cabd96e15 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:36.647173 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-080875b7-a466-4bae-9581-213cabd96e15 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:36.647649 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-080875b7-a466-4bae-9581-213cabd96e15 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:36.648412 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-080875b7-a466-4bae-9581-213cabd96e15 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:36.648838 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-080875b7-a466-4bae-9581-213cabd96e15 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:36.780060 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-080875b7-a466-4bae-9581-213cabd96e15 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:36.787441 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-080875b7-a466-4bae-9581-213cabd96e15 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 200 len: 1267 microversion: 2.1 time: 0.151989 May 28 17:37:36.788009 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 544/1093] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:36 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:37.269064 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-519ffbd3-97a1-4d01-aa53-1d61db3db598 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:37.269796 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-519ffbd3-97a1-4d01-aa53-1d61db3db598 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:37.276083 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-519ffbd3-97a1-4d01-aa53-1d61db3db598 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:37.276734 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-519ffbd3-97a1-4d01-aa53-1d61db3db598 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:37.277575 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-519ffbd3-97a1-4d01-aa53-1d61db3db598 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:37.278177 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-519ffbd3-97a1-4d01-aa53-1d61db3db598 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:37.444617 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-519ffbd3-97a1-4d01-aa53-1d61db3db598 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:37.453640 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-519ffbd3-97a1-4d01-aa53-1d61db3db598 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d" status: 200 len: 1681 microversion: 2.1 time: 0.190225 May 28 17:37:37.454309 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 550/1094] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:37 2022] GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:37.804698 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-aed89762-4131-48d2-9f83-0d1e6906eb03 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:37.805305 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-aed89762-4131-48d2-9f83-0d1e6906eb03 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:37.811911 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-aed89762-4131-48d2-9f83-0d1e6906eb03 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:37.812358 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-aed89762-4131-48d2-9f83-0d1e6906eb03 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:37.813140 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-aed89762-4131-48d2-9f83-0d1e6906eb03 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:37.813574 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-aed89762-4131-48d2-9f83-0d1e6906eb03 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:37.944521 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-aed89762-4131-48d2-9f83-0d1e6906eb03 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:37.952080 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-aed89762-4131-48d2-9f83-0d1e6906eb03 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 200 len: 1267 microversion: 2.1 time: 0.151300 May 28 17:37:37.952643 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 545/1095] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:37 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:38.471829 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-66768526-2725-4f41-9999-641c93961d39 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:38.472445 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-66768526-2725-4f41-9999-641c93961d39 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:38.479829 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-66768526-2725-4f41-9999-641c93961d39 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:38.480277 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-66768526-2725-4f41-9999-641c93961d39 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:38.481042 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-66768526-2725-4f41-9999-641c93961d39 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:38.481476 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-66768526-2725-4f41-9999-641c93961d39 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:38.630744 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-66768526-2725-4f41-9999-641c93961d39 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:38.638372 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-66768526-2725-4f41-9999-641c93961d39 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d" status: 200 len: 1681 microversion: 2.1 time: 0.170424 May 28 17:37:38.639031 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 551/1096] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:38 2022] GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:38.968822 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3ec48535-a1fb-4155-bc8a-bdd47157951b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:38.969446 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3ec48535-a1fb-4155-bc8a-bdd47157951b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:38.976042 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3ec48535-a1fb-4155-bc8a-bdd47157951b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:38.976497 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3ec48535-a1fb-4155-bc8a-bdd47157951b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:38.977257 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3ec48535-a1fb-4155-bc8a-bdd47157951b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:38.977701 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3ec48535-a1fb-4155-bc8a-bdd47157951b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:39.110404 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3ec48535-a1fb-4155-bc8a-bdd47157951b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:39.118642 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3ec48535-a1fb-4155-bc8a-bdd47157951b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 200 len: 1267 microversion: 2.1 time: 0.153596 May 28 17:37:39.119221 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 546/1097] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:38 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:39.655817 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3113903e-0d05-413c-947b-62f16856de66 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:39.656443 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3113903e-0d05-413c-947b-62f16856de66 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:39.664028 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3113903e-0d05-413c-947b-62f16856de66 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:39.664544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3113903e-0d05-413c-947b-62f16856de66 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:39.665326 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3113903e-0d05-413c-947b-62f16856de66 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:39.665767 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3113903e-0d05-413c-947b-62f16856de66 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:39.806027 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-3113903e-0d05-413c-947b-62f16856de66 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:39.829301 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3113903e-0d05-413c-947b-62f16856de66 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d" status: 200 len: 1681 microversion: 2.1 time: 0.177246 May 28 17:37:39.833883 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 552/1098] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:39 2022] GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d => generated 1681 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:40.135238 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a749d7d8-4182-451a-bd6d-6c4d972b34e4 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:40.135897 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a749d7d8-4182-451a-bd6d-6c4d972b34e4 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:40.143388 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a749d7d8-4182-451a-bd6d-6c4d972b34e4 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:40.143974 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a749d7d8-4182-451a-bd6d-6c4d972b34e4 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:40.144912 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a749d7d8-4182-451a-bd6d-6c4d972b34e4 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:40.145422 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a749d7d8-4182-451a-bd6d-6c4d972b34e4 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:40.290530 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a749d7d8-4182-451a-bd6d-6c4d972b34e4 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:40.298082 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a749d7d8-4182-451a-bd6d-6c4d972b34e4 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 200 len: 1267 microversion: 2.1 time: 0.166589 May 28 17:37:40.299364 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 547/1099] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:40 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:40.851043 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ccadde87-4c6f-4fb3-812b-78029d541b71 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:40.852319 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ccadde87-4c6f-4fb3-812b-78029d541b71 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:40.867773 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ccadde87-4c6f-4fb3-812b-78029d541b71 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:40.867986 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ccadde87-4c6f-4fb3-812b-78029d541b71 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:40.868731 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ccadde87-4c6f-4fb3-812b-78029d541b71 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:40.869169 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ccadde87-4c6f-4fb3-812b-78029d541b71 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:41.119881 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ccadde87-4c6f-4fb3-812b-78029d541b71 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:41.130056 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ccadde87-4c6f-4fb3-812b-78029d541b71 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d" status: 200 len: 1681 microversion: 2.1 time: 0.283189 May 28 17:37:41.131150 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 553/1100] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:40 2022] GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d => generated 1681 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:41.316561 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f9654d45-08ad-41b6-ab90-6fec6f8e3d4b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:41.317962 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f9654d45-08ad-41b6-ab90-6fec6f8e3d4b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:41.324686 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f9654d45-08ad-41b6-ab90-6fec6f8e3d4b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:41.325251 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f9654d45-08ad-41b6-ab90-6fec6f8e3d4b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:41.326101 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f9654d45-08ad-41b6-ab90-6fec6f8e3d4b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:41.326610 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f9654d45-08ad-41b6-ab90-6fec6f8e3d4b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:41.347461 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:37:41.553751 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f9654d45-08ad-41b6-ab90-6fec6f8e3d4b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:41.562445 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f9654d45-08ad-41b6-ab90-6fec6f8e3d4b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 200 len: 1267 microversion: 2.1 time: 0.250479 May 28 17:37:41.563129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 548/1101] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:41 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 1267 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:41.797671 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-52e998ac-23e7-41d3-b61e-1807135f9ba1 req-fa103fd6-b2bd-44e6-ab7c-4bd20639e885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a72ea47-a87d-4716-981b-423fe0a0d60d", "name": "network-vif-deleted", "tag": "25a0a848-b7b0-4228-8b72-fbe8936a2352"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:37:41.806671 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-52e998ac-23e7-41d3-b61e-1807135f9ba1 req-fa103fd6-b2bd-44e6-ab7c-4bd20639e885 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:41.807111 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-52e998ac-23e7-41d3-b61e-1807135f9ba1 req-fa103fd6-b2bd-44e6-ab7c-4bd20639e885 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:41.818512 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-52e998ac-23e7-41d3-b61e-1807135f9ba1 req-fa103fd6-b2bd-44e6-ab7c-4bd20639e885 service nova] Creating event network-vif-deleted:25a0a848-b7b0-4228-8b72-fbe8936a2352 for instance 9a72ea47-a87d-4716-981b-423fe0a0d60d on hv-cinder-84372 May 28 17:37:41.825739 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-52e998ac-23e7-41d3-b61e-1807135f9ba1 req-fa103fd6-b2bd-44e6-ab7c-4bd20639e885 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031681 May 28 17:37:41.826510 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 554/1102] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:37:42.147876 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2ae2f243-1573-496c-937c-767c207454a3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:42.148887 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2ae2f243-1573-496c-937c-767c207454a3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:42.162240 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2ae2f243-1573-496c-937c-767c207454a3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:42.162962 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2ae2f243-1573-496c-937c-767c207454a3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:42.164039 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2ae2f243-1573-496c-937c-767c207454a3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:42.164742 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2ae2f243-1573-496c-937c-767c207454a3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:42.203792 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2ae2f243-1573-496c-937c-767c207454a3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:42.204519 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2ae2f243-1573-496c-937c-767c207454a3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:42.205977 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-2ae2f243-1573-496c-937c-767c207454a3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lazy-loading 'fault' on Instance uuid 9a72ea47-a87d-4716-981b-423fe0a0d60d {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 17:37:42.256018 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2ae2f243-1573-496c-937c-767c207454a3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:42.263422 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2ae2f243-1573-496c-937c-767c207454a3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d" status: 200 len: 1332 microversion: 2.1 time: 0.119486 May 28 17:37:42.264174 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 549/1103] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:42 2022] GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d => generated 1332 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:42.580544 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-490566f9-b46e-4e71-bd5e-4648057743f7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:42.581248 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-490566f9-b46e-4e71-bd5e-4648057743f7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:42.587508 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-490566f9-b46e-4e71-bd5e-4648057743f7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:42.587950 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-490566f9-b46e-4e71-bd5e-4648057743f7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:42.588724 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-490566f9-b46e-4e71-bd5e-4648057743f7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:42.589172 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-490566f9-b46e-4e71-bd5e-4648057743f7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:42.776427 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-490566f9-b46e-4e71-bd5e-4648057743f7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:42.791266 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-490566f9-b46e-4e71-bd5e-4648057743f7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 200 len: 1267 microversion: 2.1 time: 0.215257 May 28 17:37:42.803545 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 555/1104] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:42 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 1267 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:37:43.281672 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-062523bd-3415-4474-a03d-3fb6ad6c11da tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:43.282368 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-062523bd-3415-4474-a03d-3fb6ad6c11da tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:43.289725 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-062523bd-3415-4474-a03d-3fb6ad6c11da tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:43.290180 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-062523bd-3415-4474-a03d-3fb6ad6c11da tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:43.290950 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-062523bd-3415-4474-a03d-3fb6ad6c11da tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:43.291417 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-062523bd-3415-4474-a03d-3fb6ad6c11da tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:43.306741 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-062523bd-3415-4474-a03d-3fb6ad6c11da tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] HTTP exception thrown: Instance 9a72ea47-a87d-4716-981b-423fe0a0d60d could not be found. May 28 17:37:43.308420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-062523bd-3415-4474-a03d-3fb6ad6c11da tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Request method failure captured: May 28 17:37:43.308420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d HTTP/1.1 May 28 17:37:43.308420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept: application/json May 28 17:37:43.308420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity May 28 17:37:43.308420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Connection: close May 28 17:37:43.308420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Length: 0 May 28 17:37:43.308420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Type: application/json May 28 17:37:43.308420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 May 28 17:37:43.308420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None May 28 17:37:43.308420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 May 28 17:37:43.308420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABiklztpzsrcs87QXRJpScgk-5tUukjwPy1pG5nwYCeqw-1TdfbNHEPQv0dxfORMmAI_huWNfz4S1kkPQDKvHAPGaV0itPNNhduphbnIQQ9CdIotGmgnrod8uAS5LCp8f9bs3_RlkUgWcVbaRmZwj6AERxTjQmBOF2VAsv1p_k3m3IU8vI May 28 17:37:43.308420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Id: None May 28 17:37:43.308420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Name: None May 28 17:37:43.308420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed May 28 17:37:43.308420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True May 28 17:37:43.308420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default May 28 17:37:43.308420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default May 28 17:37:43.308420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Id: 9525b35792a04dc3a6f109cb39ee9d50 May 28 17:37:43.308420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:37:43.308420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Role: reader,member May 28 17:37:43.308420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Roles: reader,member May 28 17:37:43.310061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9525b35792a04dc3a6f109cb39ee9d50", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:37:43.310061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:37:43.310061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 9525b35792a04dc3a6f109cb39ee9d50 May 28 17:37:43.310061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:37:43.310061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeNegativeTest-1796155594-project May 28 17:37:43.310061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default May 28 17:37:43.310061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default May 28 17:37:43.310061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Id: 7343386004e24474bc0af9126f47182b May 28 17:37:43.310061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeNegativeTest-1796155594-project May 28 17:37:43.310061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: method: > May 28 17:37:43.310061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: exception: Instance 9a72ea47-a87d-4716-981b-423fe0a0d60d could not be found. May 28 17:37:43.310061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: action_args: {'id': '9a72ea47-a87d-4716-981b-423fe0a0d60d'} May 28 17:37:43.310898 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:37:43.310898 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:37:43.310898 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:37:43.310898 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:37:43.310898 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:37:43.310898 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:37:43.310898 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:37:43.310898 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:37:43.310898 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:37:43.310898 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:37:43.310898 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a72ea47-a87d-4716-981b-423fe0a0d60d could not be found. May 28 17:37:43.310898 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:37:43.310898 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:37:43.310898 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:37:43.310898 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:37:43.310898 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:37:43.310898 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:37:43.310898 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:37:43.310898 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:37:43.310898 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:37:43.312219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:37:43.312219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:37:43.312219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:37:43.312219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:37:43.312219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:37:43.312219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:37:43.312219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:37:43.312219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a72ea47-a87d-4716-981b-423fe0a0d60d could not be found. May 28 17:37:43.312219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:37:43.312219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:37:43.312219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:37:43.312219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:37:43.312219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:37:43.312219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:37:43.312219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:37:43.312219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:37:43.312219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a72ea47-a87d-4716-981b-423fe0a0d60d could not be found. May 28 17:37:43.312219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:37:43.313351 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-062523bd-3415-4474-a03d-3fb6ad6c11da tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Returning 404 to user: Instance 9a72ea47-a87d-4716-981b-423fe0a0d60d could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:37:43.313351 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-062523bd-3415-4474-a03d-3fb6ad6c11da tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d" status: 404 len: 111 microversion: 2.1 time: 0.032406 May 28 17:37:43.313351 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 550/1105] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:43 2022] GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:37:43.321740 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c819e590-c970-4cc8-bc31-42e621fc1e6f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '.version_select at 0x7f9efcb90dc0>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:43.339958 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c819e590-c970-4cc8-bc31-42e621fc1e6f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1084253352" status: 202 len: 0 microversion: 2.1 time: 0.021961 May 28 17:37:43.340685 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 556/1106] 10.222.0.33 () {58 vars in 1220 bytes} [Sat May 28 17:37:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1084253352 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 17:37:43.810347 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-ae7038cf-7094-4881-b7c5-8ad1573495dc tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:43.810964 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-ae7038cf-7094-4881-b7c5-8ad1573495dc tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:43.817915 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ae7038cf-7094-4881-b7c5-8ad1573495dc tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:43.818357 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ae7038cf-7094-4881-b7c5-8ad1573495dc tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:43.819250 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ae7038cf-7094-4881-b7c5-8ad1573495dc tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:43.819929 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-ae7038cf-7094-4881-b7c5-8ad1573495dc tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:44.043851 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-ae7038cf-7094-4881-b7c5-8ad1573495dc tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:44.052421 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-ae7038cf-7094-4881-b7c5-8ad1573495dc tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 200 len: 1267 microversion: 2.1 time: 0.245893 May 28 17:37:44.053074 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 551/1107] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:43 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 1267 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:44.108534 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-21eef6ef-0d9a-4f33-808f-d320e4217e8f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:44.109116 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-21eef6ef-0d9a-4f33-808f-d320e4217e8f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 6863e51f-850f-4d83-a5ea-34408f176184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:44.115415 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-21eef6ef-0d9a-4f33-808f-d320e4217e8f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:44.115862 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-21eef6ef-0d9a-4f33-808f-d320e4217e8f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:44.116628 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-21eef6ef-0d9a-4f33-808f-d320e4217e8f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:44.117057 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-21eef6ef-0d9a-4f33-808f-d320e4217e8f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:44.120954 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=100 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:37:44.203504 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-21eef6ef-0d9a-4f33-808f-d320e4217e8f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lazy-loading 'services' on Instance uuid 6863e51f-850f-4d83-a5ea-34408f176184 {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 17:37:44.279678 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-21eef6ef-0d9a-4f33-808f-d320e4217e8f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184/os-volume_attachments/889cc987-3bbb-4b93-903c-7dcfb2541d55" status: 202 len: 0 microversion: 2.1 time: 0.175662 May 28 17:37:44.280263 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 557/1108] 10.222.0.33 () {58 vars in 1415 bytes} [Sat May 28 17:37:44 2022] DELETE /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184/os-volume_attachments/889cc987-3bbb-4b93-903c-7dcfb2541d55 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 17:37:44.289564 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-40f740e6-b841-42fc-a621-0c12f58213d1 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:44.290522 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-40f740e6-b841-42fc-a621-0c12f58213d1 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 6863e51f-850f-4d83-a5ea-34408f176184] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:44.297382 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-40f740e6-b841-42fc-a621-0c12f58213d1 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:44.297937 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-40f740e6-b841-42fc-a621-0c12f58213d1 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:44.298992 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-40f740e6-b841-42fc-a621-0c12f58213d1 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:44.299716 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-40f740e6-b841-42fc-a621-0c12f58213d1 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:44.335470 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-40f740e6-b841-42fc-a621-0c12f58213d1 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050833 May 28 17:37:44.336032 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 552/1109] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 17:37:44 2022] GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:37:45.070610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-5ce94f39-7a9c-4bce-a50a-41d027446311 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:45.071321 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-5ce94f39-7a9c-4bce-a50a-41d027446311 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:45.077676 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5ce94f39-7a9c-4bce-a50a-41d027446311 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:45.078251 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5ce94f39-7a9c-4bce-a50a-41d027446311 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:45.079035 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5ce94f39-7a9c-4bce-a50a-41d027446311 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:45.079508 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-5ce94f39-7a9c-4bce-a50a-41d027446311 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:45.289680 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-5ce94f39-7a9c-4bce-a50a-41d027446311 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:45.304279 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-5ce94f39-7a9c-4bce-a50a-41d027446311 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 200 len: 1267 microversion: 2.1 time: 0.238664 May 28 17:37:45.304980 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 558/1110] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:45 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 1267 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:45.352555 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-fb967409-4553-45dc-9c0d-771729a9a4b7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:45.353720 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-fb967409-4553-45dc-9c0d-771729a9a4b7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 6863e51f-850f-4d83-a5ea-34408f176184] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:45.360434 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fb967409-4553-45dc-9c0d-771729a9a4b7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:45.360980 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fb967409-4553-45dc-9c0d-771729a9a4b7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:45.361842 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fb967409-4553-45dc-9c0d-771729a9a4b7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:45.362357 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-fb967409-4553-45dc-9c0d-771729a9a4b7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:45.394011 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-fb967409-4553-45dc-9c0d-771729a9a4b7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046608 May 28 17:37:45.399717 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 553/1111] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 17:37:45 2022] GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 17:37:45.458115 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2d9efbca-a8e5-47a3-8e9f-b0d9ccb848cb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:45.458873 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2d9efbca-a8e5-47a3-8e9f-b0d9ccb848cb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 6863e51f-850f-4d83-a5ea-34408f176184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:45.465154 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2d9efbca-a8e5-47a3-8e9f-b0d9ccb848cb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:45.465813 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2d9efbca-a8e5-47a3-8e9f-b0d9ccb848cb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:45.466599 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2d9efbca-a8e5-47a3-8e9f-b0d9ccb848cb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:45.467036 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2d9efbca-a8e5-47a3-8e9f-b0d9ccb848cb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:45.493708 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2d9efbca-a8e5-47a3-8e9f-b0d9ccb848cb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 6863e51f-850f-4d83-a5ea-34408f176184] Going to try to terminate instance {{(pid=117604) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 17:37:45.590214 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2d9efbca-a8e5-47a3-8e9f-b0d9ccb848cb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184" status: 204 len: 0 microversion: 2.1 time: 0.135571 May 28 17:37:45.591516 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 559/1112] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 17:37:45 2022] DELETE /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 17:37:45.602158 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-af850896-a06d-4d73-9271-acfbba155ba8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:45.603293 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-af850896-a06d-4d73-9271-acfbba155ba8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 6863e51f-850f-4d83-a5ea-34408f176184] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:45.609683 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-af850896-a06d-4d73-9271-acfbba155ba8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:45.610138 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-af850896-a06d-4d73-9271-acfbba155ba8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:45.610943 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-af850896-a06d-4d73-9271-acfbba155ba8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:45.611409 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-af850896-a06d-4d73-9271-acfbba155ba8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:45.781208 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-af850896-a06d-4d73-9271-acfbba155ba8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:45.791225 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-af850896-a06d-4d73-9271-acfbba155ba8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184" status: 200 len: 1677 microversion: 2.1 time: 0.194452 May 28 17:37:45.792484 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 554/1113] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:45 2022] GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184 => generated 1677 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:46.044984 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-fb941c7b-3d40-47b1-8f67-d6847f825f57 req-61a824a9-d671-46ba-8b6f-d1f3ad8f7f73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b782e2-0501-4467-9b07-0a0766795ad4", "name": "network-vif-plugged", "status": "completed", "tag": "e8ae62d4-a8b6-4a83-8ce0-f58a2953d5ca"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:37:46.053091 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-fb941c7b-3d40-47b1-8f67-d6847f825f57 req-61a824a9-d671-46ba-8b6f-d1f3ad8f7f73 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:46.053878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-fb941c7b-3d40-47b1-8f67-d6847f825f57 req-61a824a9-d671-46ba-8b6f-d1f3ad8f7f73 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:46.065318 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-fb941c7b-3d40-47b1-8f67-d6847f825f57 req-61a824a9-d671-46ba-8b6f-d1f3ad8f7f73 service nova] Creating event network-vif-plugged:e8ae62d4-a8b6-4a83-8ce0-f58a2953d5ca for instance 03b782e2-0501-4467-9b07-0a0766795ad4 on hv-cinder-84372 May 28 17:37:46.070367 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-fb941c7b-3d40-47b1-8f67-d6847f825f57 req-61a824a9-d671-46ba-8b6f-d1f3ad8f7f73 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.238981 May 28 17:37:46.070966 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 560/1114] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:37:46.322484 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-566a35d5-e96f-434e-bedc-20377a72d001 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:46.323199 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-566a35d5-e96f-434e-bedc-20377a72d001 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:46.329748 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-566a35d5-e96f-434e-bedc-20377a72d001 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:46.330266 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-566a35d5-e96f-434e-bedc-20377a72d001 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:46.331163 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-566a35d5-e96f-434e-bedc-20377a72d001 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:46.331690 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-566a35d5-e96f-434e-bedc-20377a72d001 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:46.725847 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-566a35d5-e96f-434e-bedc-20377a72d001 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:46.733247 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-566a35d5-e96f-434e-bedc-20377a72d001 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 200 len: 1267 microversion: 2.1 time: 0.415200 May 28 17:37:46.733811 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 555/1115] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:46 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 1267 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:46.810019 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2223a3b7-fc9b-4664-a8ad-dbfe169e4db9 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:46.810739 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2223a3b7-fc9b-4664-a8ad-dbfe169e4db9 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 6863e51f-850f-4d83-a5ea-34408f176184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:46.818775 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2223a3b7-fc9b-4664-a8ad-dbfe169e4db9 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:46.819221 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2223a3b7-fc9b-4664-a8ad-dbfe169e4db9 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:46.820014 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2223a3b7-fc9b-4664-a8ad-dbfe169e4db9 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:46.820449 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2223a3b7-fc9b-4664-a8ad-dbfe169e4db9 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:46.951261 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-2223a3b7-fc9b-4664-a8ad-dbfe169e4db9 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:46.959516 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2223a3b7-fc9b-4664-a8ad-dbfe169e4db9 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184" status: 200 len: 1677 microversion: 2.1 time: 0.153714 May 28 17:37:46.960500 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 561/1116] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:46 2022] GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:47.528586 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-73d87963-ad9f-46d9-9817-1944b6694cdc tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-840438979", "imageRef": "b2aab55c-a793-472a-bc32-81af689ad609", "flavorRef": "452"}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:37:47.577815 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.network.neutron [None req-73d87963-ad9f-46d9-9817-1944b6694cdc tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] validate_networks() for None {{(pid=117605) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 17:37:47.750027 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e16619c8-7bb7-476a-88c7-012017848c1d tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:47.750659 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e16619c8-7bb7-476a-88c7-012017848c1d tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:47.757569 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e16619c8-7bb7-476a-88c7-012017848c1d tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:47.758019 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e16619c8-7bb7-476a-88c7-012017848c1d tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:47.758781 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e16619c8-7bb7-476a-88c7-012017848c1d tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:47.759213 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e16619c8-7bb7-476a-88c7-012017848c1d tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:47.876537 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-73d87963-ad9f-46d9-9817-1944b6694cdc tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Flavor limits 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 17:37:47.877037 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-73d87963-ad9f-46d9-9817-1944b6694cdc tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Image limits 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 17:37:47.877426 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-73d87963-ad9f-46d9-9817-1944b6694cdc tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Flavor pref 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 17:37:47.878098 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-73d87963-ad9f-46d9-9817-1944b6694cdc tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Image pref 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 17:37:47.878515 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-73d87963-ad9f-46d9-9817-1944b6694cdc tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 17:37:47.888750 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-73d87963-ad9f-46d9-9817-1944b6694cdc tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:47.889197 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-73d87963-ad9f-46d9-9817-1944b6694cdc tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:47.889990 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-73d87963-ad9f-46d9-9817-1944b6694cdc tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:47.890440 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-73d87963-ad9f-46d9-9817-1944b6694cdc tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:47.895727 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e16619c8-7bb7-476a-88c7-012017848c1d tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:47.903455 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e16619c8-7bb7-476a-88c7-012017848c1d tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 200 len: 1267 microversion: 2.1 time: 0.157252 May 28 17:37:47.904030 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 562/1117] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:47 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:37:47.908291 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-73d87963-ad9f-46d9-9817-1944b6694cdc tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Getting quotas for project f785fe1f5aea4aaaaac50187f1ef765a. Resources: {'instances', 'cores', 'ram'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:37:47.912462 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-73d87963-ad9f-46d9-9817-1944b6694cdc tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Getting quotas for user 89f2c92f417f42e6957bc97a27782092 and project f785fe1f5aea4aaaaac50187f1ef765a. Resources: {'instances', 'cores', 'ram'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:37:47.924002 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-73d87963-ad9f-46d9-9817-1944b6694cdc tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Going to run 1 instances... {{(pid=117605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 17:37:47.926354 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-73d87963-ad9f-46d9-9817-1944b6694cdc tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] [instance: bee73b8a-aa12-4117-b567-bdb7d7e47f7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b2aab55c-a793-472a-bc32-81af689ad609',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 17:37:47.972523 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-73d87963-ad9f-46d9-9817-1944b6694cdc tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.447519 May 28 17:37:47.973298 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 556/1118] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 17:37:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 17:37:47.977009 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d31e54f9-f7f7-488f-ab8a-ac7680cf5ec5 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:47.977770 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d31e54f9-f7f7-488f-ab8a-ac7680cf5ec5 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 6863e51f-850f-4d83-a5ea-34408f176184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:47.982468 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-b86aa4b5-06c5-44be-9d98-3f21de499dac tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:47.983083 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-b86aa4b5-06c5-44be-9d98-3f21de499dac tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] [instance: bee73b8a-aa12-4117-b567-bdb7d7e47f7d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:47.984206 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d31e54f9-f7f7-488f-ab8a-ac7680cf5ec5 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:47.984656 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d31e54f9-f7f7-488f-ab8a-ac7680cf5ec5 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:47.985644 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d31e54f9-f7f7-488f-ab8a-ac7680cf5ec5 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:47.986091 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d31e54f9-f7f7-488f-ab8a-ac7680cf5ec5 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:48.052779 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-b86aa4b5-06c5-44be-9d98-3f21de499dac tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f2c92f417f42e6957bc97a27782092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f785fe1f5aea4aaaaac50187f1ef765a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:48.059633 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-b86aa4b5-06c5-44be-9d98-3f21de499dac tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] 10.222.0.33 "GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d" status: 200 len: 1214 microversion: 2.1 time: 0.080809 May 28 17:37:48.060406 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 557/1119] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:47 2022] GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:37:48.130733 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d31e54f9-f7f7-488f-ab8a-ac7680cf5ec5 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:48.138729 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d31e54f9-f7f7-488f-ab8a-ac7680cf5ec5 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184" status: 200 len: 1677 microversion: 2.1 time: 0.165833 May 28 17:37:48.139295 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 563/1120] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:47 2022] GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:37:48.920452 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3c0322d3-7ae7-48b6-8f9f-97df495d65b6 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:48.921107 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3c0322d3-7ae7-48b6-8f9f-97df495d65b6 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:48.928778 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3c0322d3-7ae7-48b6-8f9f-97df495d65b6 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:48.929229 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3c0322d3-7ae7-48b6-8f9f-97df495d65b6 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:48.929997 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3c0322d3-7ae7-48b6-8f9f-97df495d65b6 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:48.930434 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3c0322d3-7ae7-48b6-8f9f-97df495d65b6 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:49.084742 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-aca5a92a-e813-4aba-923b-eab6a3814380 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:49.085780 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-aca5a92a-e813-4aba-923b-eab6a3814380 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] [instance: bee73b8a-aa12-4117-b567-bdb7d7e47f7d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:49.091008 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3c0322d3-7ae7-48b6-8f9f-97df495d65b6 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:49.094290 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aca5a92a-e813-4aba-923b-eab6a3814380 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:49.094856 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aca5a92a-e813-4aba-923b-eab6a3814380 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:49.096577 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aca5a92a-e813-4aba-923b-eab6a3814380 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:49.097074 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-aca5a92a-e813-4aba-923b-eab6a3814380 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:49.106626 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3c0322d3-7ae7-48b6-8f9f-97df495d65b6 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 200 len: 1267 microversion: 2.1 time: 0.189950 May 28 17:37:49.108042 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 558/1121] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:48 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:49.156328 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-bbb28f4f-a512-4183-a021-63c67ff44d6f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:49.156863 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-bbb28f4f-a512-4183-a021-63c67ff44d6f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 6863e51f-850f-4d83-a5ea-34408f176184] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:49.163528 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bbb28f4f-a512-4183-a021-63c67ff44d6f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:49.163981 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bbb28f4f-a512-4183-a021-63c67ff44d6f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:49.164758 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bbb28f4f-a512-4183-a021-63c67ff44d6f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:49.165194 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-bbb28f4f-a512-4183-a021-63c67ff44d6f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:49.197446 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-aca5a92a-e813-4aba-923b-eab6a3814380 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f2c92f417f42e6957bc97a27782092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f785fe1f5aea4aaaaac50187f1ef765a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:49.207125 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-aca5a92a-e813-4aba-923b-eab6a3814380 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] 10.222.0.33 "GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d" status: 200 len: 1266 microversion: 2.1 time: 0.126196 May 28 17:37:49.207817 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 564/1122] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:49 2022] GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d => generated 1266 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:49.239500 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-bbb28f4f-a512-4183-a021-63c67ff44d6f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:49.248831 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-bbb28f4f-a512-4183-a021-63c67ff44d6f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184" status: 200 len: 1609 microversion: 2.1 time: 0.096585 May 28 17:37:49.249523 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 559/1123] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:49 2022] GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184 => generated 1609 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:37:49.457567 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-1b45c4fd-6e6d-4258-91ed-9aa959ea7641 req-2e771f3a-c856-4c70-a755-5ab27f3ab5f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6863e51f-850f-4d83-a5ea-34408f176184", "name": "network-vif-deleted", "tag": "f9b3d611-66b6-43d5-b2bc-e8228c900bb3"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:37:49.466655 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-1b45c4fd-6e6d-4258-91ed-9aa959ea7641 req-2e771f3a-c856-4c70-a755-5ab27f3ab5f4 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:49.467099 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-1b45c4fd-6e6d-4258-91ed-9aa959ea7641 req-2e771f3a-c856-4c70-a755-5ab27f3ab5f4 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:49.480805 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-1b45c4fd-6e6d-4258-91ed-9aa959ea7641 req-2e771f3a-c856-4c70-a755-5ab27f3ab5f4 service nova] Creating event network-vif-deleted:f9b3d611-66b6-43d5-b2bc-e8228c900bb3 for instance 6863e51f-850f-4d83-a5ea-34408f176184 on hv-cinder-84372 May 28 17:37:49.486220 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-1b45c4fd-6e6d-4258-91ed-9aa959ea7641 req-2e771f3a-c856-4c70-a755-5ab27f3ab5f4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033190 May 28 17:37:49.486811 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 565/1124] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:37:50.126151 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-49f68e29-a3d7-4e6c-a9de-22445787fd1a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:50.127022 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-49f68e29-a3d7-4e6c-a9de-22445787fd1a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:50.134716 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-49f68e29-a3d7-4e6c-a9de-22445787fd1a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:50.135240 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-49f68e29-a3d7-4e6c-a9de-22445787fd1a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:50.136149 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-49f68e29-a3d7-4e6c-a9de-22445787fd1a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:50.136533 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-49f68e29-a3d7-4e6c-a9de-22445787fd1a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:50.230765 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e9ef738e-57eb-4f72-a372-248eea6e9e97 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:50.231672 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e9ef738e-57eb-4f72-a372-248eea6e9e97 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] [instance: bee73b8a-aa12-4117-b567-bdb7d7e47f7d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:50.249805 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e9ef738e-57eb-4f72-a372-248eea6e9e97 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:50.250437 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e9ef738e-57eb-4f72-a372-248eea6e9e97 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:50.251422 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e9ef738e-57eb-4f72-a372-248eea6e9e97 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:50.252018 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e9ef738e-57eb-4f72-a372-248eea6e9e97 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:50.313813 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-49f68e29-a3d7-4e6c-a9de-22445787fd1a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:50.322614 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-49f68e29-a3d7-4e6c-a9de-22445787fd1a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 200 len: 1455 microversion: 2.1 time: 0.200565 May 28 17:37:50.323309 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 560/1125] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:50 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 1455 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:50.329689 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a370ad40-be17-4e72-a7d0-ccfa2176f5c4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:50.331153 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a370ad40-be17-4e72-a7d0-ccfa2176f5c4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 6863e51f-850f-4d83-a5ea-34408f176184] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:50.335745 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:37:50.342086 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a370ad40-be17-4e72-a7d0-ccfa2176f5c4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:50.342793 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a370ad40-be17-4e72-a7d0-ccfa2176f5c4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:50.343818 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a370ad40-be17-4e72-a7d0-ccfa2176f5c4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:50.344259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a370ad40-be17-4e72-a7d0-ccfa2176f5c4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:50.386165 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a370ad40-be17-4e72-a7d0-ccfa2176f5c4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:50.386657 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a370ad40-be17-4e72-a7d0-ccfa2176f5c4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:50.387115 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-a370ad40-be17-4e72-a7d0-ccfa2176f5c4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lazy-loading 'fault' on Instance uuid 6863e51f-850f-4d83-a5ea-34408f176184 {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 17:37:50.444291 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-a370ad40-be17-4e72-a7d0-ccfa2176f5c4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:50.455085 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a370ad40-be17-4e72-a7d0-ccfa2176f5c4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184" status: 200 len: 1329 microversion: 2.1 time: 0.129739 May 28 17:37:50.455728 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 561/1126] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:50 2022] GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184 => generated 1329 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:50.462563 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-673a848a-90d5-4e41-a9e3-7a22456233a7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:50.463533 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-673a848a-90d5-4e41-a9e3-7a22456233a7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:50.470161 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-673a848a-90d5-4e41-a9e3-7a22456233a7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:50.471234 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-673a848a-90d5-4e41-a9e3-7a22456233a7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:50.472063 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-673a848a-90d5-4e41-a9e3-7a22456233a7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:50.472987 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-673a848a-90d5-4e41-a9e3-7a22456233a7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:50.642367 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-673a848a-90d5-4e41-a9e3-7a22456233a7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:50.653326 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-e9ef738e-57eb-4f72-a372-248eea6e9e97 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f2c92f417f42e6957bc97a27782092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f785fe1f5aea4aaaaac50187f1ef765a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:50.662370 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e9ef738e-57eb-4f72-a372-248eea6e9e97 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] 10.222.0.33 "GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d" status: 200 len: 1272 microversion: 2.1 time: 0.437111 May 28 17:37:50.674313 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-673a848a-90d5-4e41-a9e3-7a22456233a7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 200 len: 1455 microversion: 2.1 time: 0.206218 May 28 17:37:50.674992 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 562/1127] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:50 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 1455 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:50.686556 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 566/1128] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:50 2022] GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d => generated 1272 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:51.473516 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4569be89-b1f4-4188-a6da-368a127057b8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:51.474734 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-4569be89-b1f4-4188-a6da-368a127057b8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 6863e51f-850f-4d83-a5ea-34408f176184] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:51.482058 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4569be89-b1f4-4188-a6da-368a127057b8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:51.482754 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4569be89-b1f4-4188-a6da-368a127057b8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:51.483791 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4569be89-b1f4-4188-a6da-368a127057b8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:51.484597 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-4569be89-b1f4-4188-a6da-368a127057b8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:51.508140 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-4569be89-b1f4-4188-a6da-368a127057b8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] HTTP exception thrown: Instance 6863e51f-850f-4d83-a5ea-34408f176184 could not be found. May 28 17:37:51.509694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4569be89-b1f4-4188-a6da-368a127057b8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Request method failure captured: May 28 17:37:51.509694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184 HTTP/1.1 May 28 17:37:51.509694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept: application/json May 28 17:37:51.509694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity May 28 17:37:51.509694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Connection: close May 28 17:37:51.509694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Length: 0 May 28 17:37:51.509694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Type: application/json May 28 17:37:51.509694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 May 28 17:37:51.509694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None May 28 17:37:51.509694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 May 28 17:37:51.509694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABiklztpzsrcs87QXRJpScgk-5tUukjwPy1pG5nwYCeqw-1TdfbNHEPQv0dxfORMmAI_huWNfz4S1kkPQDKvHAPGaV0itPNNhduphbnIQQ9CdIotGmgnrod8uAS5LCp8f9bs3_RlkUgWcVbaRmZwj6AERxTjQmBOF2VAsv1p_k3m3IU8vI May 28 17:37:51.509694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Id: None May 28 17:37:51.509694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Name: None May 28 17:37:51.509694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed May 28 17:37:51.509694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True May 28 17:37:51.509694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default May 28 17:37:51.509694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default May 28 17:37:51.509694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Id: 9525b35792a04dc3a6f109cb39ee9d50 May 28 17:37:51.509694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:37:51.509694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Role: reader,member May 28 17:37:51.509694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Roles: reader,member May 28 17:37:51.511157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9525b35792a04dc3a6f109cb39ee9d50", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:37:51.511157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:37:51.511157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 9525b35792a04dc3a6f109cb39ee9d50 May 28 17:37:51.511157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:37:51.511157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeNegativeTest-1796155594-project May 28 17:37:51.511157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default May 28 17:37:51.511157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default May 28 17:37:51.511157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Id: 7343386004e24474bc0af9126f47182b May 28 17:37:51.511157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeNegativeTest-1796155594-project May 28 17:37:51.511157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: method: > May 28 17:37:51.511157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: exception: Instance 6863e51f-850f-4d83-a5ea-34408f176184 could not be found. May 28 17:37:51.511157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: action_args: {'id': '6863e51f-850f-4d83-a5ea-34408f176184'} May 28 17:37:51.512019 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:37:51.512019 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:37:51.512019 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:37:51.512019 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:37:51.512019 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:37:51.512019 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:37:51.512019 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:37:51.512019 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:37:51.512019 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:37:51.512019 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:37:51.512019 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6863e51f-850f-4d83-a5ea-34408f176184 could not be found. May 28 17:37:51.512019 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:37:51.512019 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:37:51.512019 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:37:51.512019 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:37:51.512019 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:37:51.512019 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:37:51.512019 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:37:51.512019 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:37:51.512019 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:37:51.513368 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:37:51.513368 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:37:51.513368 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:37:51.513368 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:37:51.513368 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:37:51.513368 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:37:51.513368 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:37:51.513368 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6863e51f-850f-4d83-a5ea-34408f176184 could not be found. May 28 17:37:51.513368 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:37:51.513368 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:37:51.513368 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:37:51.513368 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:37:51.513368 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:37:51.513368 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:37:51.513368 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:37:51.513368 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:37:51.513368 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6863e51f-850f-4d83-a5ea-34408f176184 could not be found. May 28 17:37:51.513368 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:37:51.514545 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-4569be89-b1f4-4188-a6da-368a127057b8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Returning 404 to user: Instance 6863e51f-850f-4d83-a5ea-34408f176184 could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:37:51.514545 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-4569be89-b1f4-4188-a6da-368a127057b8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184" status: 404 len: 111 microversion: 2.1 time: 0.042211 May 28 17:37:51.514545 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 563/1129] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:51 2022] GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:37:51.523381 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-035cd165-efbb-46ff-9f17-412a792969d9 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '.version_select at 0x7f9efcb90dc0>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:51.531926 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:37:51.552618 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-035cd165-efbb-46ff-9f17-412a792969d9 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-84358712" status: 202 len: 0 microversion: 2.1 time: 0.035820 May 28 17:37:51.556802 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 567/1130] 10.222.0.33 () {58 vars in 1214 bytes} [Sat May 28 17:37:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-84358712 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 17:37:51.693214 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-69c8ff65-3e06-4bfd-8d0d-c0660edb5a9d tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:51.693848 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-69c8ff65-3e06-4bfd-8d0d-c0660edb5a9d tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] [instance: bee73b8a-aa12-4117-b567-bdb7d7e47f7d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:51.700314 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-69c8ff65-3e06-4bfd-8d0d-c0660edb5a9d tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:51.701050 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-69c8ff65-3e06-4bfd-8d0d-c0660edb5a9d tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:51.702123 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-69c8ff65-3e06-4bfd-8d0d-c0660edb5a9d tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:51.702774 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-69c8ff65-3e06-4bfd-8d0d-c0660edb5a9d tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:52.017956 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-5b596e2e-7c84-4961-89d9-705bc7707bc6 req-395e8c0e-a8b8-4df3-91ea-7a38f9f85bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bee73b8a-aa12-4117-b567-bdb7d7e47f7d", "tag": "d6d5750f-773b-493d-b7e7-f03eaa280fe2"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:37:52.032235 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-5b596e2e-7c84-4961-89d9-705bc7707bc6 req-395e8c0e-a8b8-4df3-91ea-7a38f9f85bd1 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:52.033169 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-5b596e2e-7c84-4961-89d9-705bc7707bc6 req-395e8c0e-a8b8-4df3-91ea-7a38f9f85bd1 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:52.047783 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-5b596e2e-7c84-4961-89d9-705bc7707bc6 req-395e8c0e-a8b8-4df3-91ea-7a38f9f85bd1 service nova] Creating event network-changed:d6d5750f-773b-493d-b7e7-f03eaa280fe2 for instance bee73b8a-aa12-4117-b567-bdb7d7e47f7d on hv-cinder-84372 May 28 17:37:52.054621 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-69c8ff65-3e06-4bfd-8d0d-c0660edb5a9d tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f2c92f417f42e6957bc97a27782092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f785fe1f5aea4aaaaac50187f1ef765a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:52.066704 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-69c8ff65-3e06-4bfd-8d0d-c0660edb5a9d tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] 10.222.0.33 "GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d" status: 200 len: 1314 microversion: 2.1 time: 0.377193 May 28 17:37:52.066970 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-5b596e2e-7c84-4961-89d9-705bc7707bc6 req-395e8c0e-a8b8-4df3-91ea-7a38f9f85bd1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052794 May 28 17:37:52.067690 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 564/1131] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:51 2022] GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:52.071665 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 568/1132] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:37:52.958421 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1bec43f4-b72c-4c1b-b6cc-1b68cda63cc1 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Action: 'create', calling method: .version_select at 0x7f9efc37d430>, body: {"keypair": {"name": "tempest-keypair-1048827598", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuBGAVxeYrjkGfbPuqzEwKtboxRXLMcdJazPtRYcxiLTcuyyxoPPga807bDKGJA9n2FdS97361DLGYhMYMq1b/np8AULppZSeLsgD6u1GdGp+tUnhbze3Dcc/BiXVjG0w=="}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:37:52.973603 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-1bec43f4-b72c-4c1b-b6cc-1b68cda63cc1 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Getting quotas for project 9525b35792a04dc3a6f109cb39ee9d50. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:37:52.977448 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-1bec43f4-b72c-4c1b-b6cc-1b68cda63cc1 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Getting quotas for user 7343386004e24474bc0af9126f47182b and project 9525b35792a04dc3a6f109cb39ee9d50. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:37:53.000043 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1bec43f4-b72c-4c1b-b6cc-1b68cda63cc1 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046212 May 28 17:37:53.000864 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 565/1133] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 17:37:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:37:53.085694 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-7ad8a6db-c994-4f02-90a6-736b71d863f6 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:53.087027 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-7ad8a6db-c994-4f02-90a6-736b71d863f6 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] [instance: bee73b8a-aa12-4117-b567-bdb7d7e47f7d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:53.094818 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7ad8a6db-c994-4f02-90a6-736b71d863f6 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:53.095524 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7ad8a6db-c994-4f02-90a6-736b71d863f6 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:53.096495 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7ad8a6db-c994-4f02-90a6-736b71d863f6 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:53.097189 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7ad8a6db-c994-4f02-90a6-736b71d863f6 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:53.312450 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7ad8a6db-c994-4f02-90a6-736b71d863f6 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f2c92f417f42e6957bc97a27782092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f785fe1f5aea4aaaaac50187f1ef765a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:53.321206 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-7ad8a6db-c994-4f02-90a6-736b71d863f6 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] 10.222.0.33 "GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d" status: 200 len: 1314 microversion: 2.1 time: 0.240951 May 28 17:37:53.331014 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 569/1134] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:53 2022] GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:53.470537 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-5131a447-9992-4272-a552-6eff17b88d62 req-302480b1-5165-49fe-b39c-353f12ac8197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03b782e2-0501-4467-9b07-0a0766795ad4", "tag": "e8ae62d4-a8b6-4a83-8ce0-f58a2953d5ca"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:37:53.479697 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-5131a447-9992-4272-a552-6eff17b88d62 req-302480b1-5165-49fe-b39c-353f12ac8197 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:53.480065 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-5131a447-9992-4272-a552-6eff17b88d62 req-302480b1-5165-49fe-b39c-353f12ac8197 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:53.492469 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-5131a447-9992-4272-a552-6eff17b88d62 req-302480b1-5165-49fe-b39c-353f12ac8197 service nova] Creating event network-changed:e8ae62d4-a8b6-4a83-8ce0-f58a2953d5ca for instance 03b782e2-0501-4467-9b07-0a0766795ad4 on hv-cinder-84372 May 28 17:37:53.497804 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-5131a447-9992-4272-a552-6eff17b88d62 req-302480b1-5165-49fe-b39c-353f12ac8197 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030967 May 28 17:37:53.498516 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 566/1135] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:37:54.338524 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-15d9a6ed-5d59-49e5-ba32-7e152fd1e1a8 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:54.339136 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-15d9a6ed-5d59-49e5-ba32-7e152fd1e1a8 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] [instance: bee73b8a-aa12-4117-b567-bdb7d7e47f7d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:54.346408 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-15d9a6ed-5d59-49e5-ba32-7e152fd1e1a8 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:54.346814 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-15d9a6ed-5d59-49e5-ba32-7e152fd1e1a8 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:54.348632 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-15d9a6ed-5d59-49e5-ba32-7e152fd1e1a8 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:54.349058 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-15d9a6ed-5d59-49e5-ba32-7e152fd1e1a8 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:54.482489 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a284bdb2-1299-499c-9b3c-1ee70562bc29 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1712550044", "imageRef": "b2aab55c-a793-472a-bc32-81af689ad609", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f73c6d30-f59b-4e03-9c62-138278150c67"}], "security_groups": [{"name": "tempest-securitygroup--1430307621"}], "key_name": "tempest-keypair-1048827598", "user_data": "}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:37:54.486840 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-15d9a6ed-5d59-49e5-ba32-7e152fd1e1a8 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f2c92f417f42e6957bc97a27782092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f785fe1f5aea4aaaaac50187f1ef765a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:54.495333 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-15d9a6ed-5d59-49e5-ba32-7e152fd1e1a8 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] 10.222.0.33 "GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d" status: 200 len: 1314 microversion: 2.1 time: 0.160670 May 28 17:37:54.495919 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 570/1136] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:54 2022] GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:54.586066 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.network.neutron [None req-a284bdb2-1299-499c-9b3c-1ee70562bc29 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] validate_networks() for [('f73c6d30-f59b-4e03-9c62-138278150c67', None, None, None, None, None)] {{(pid=117605) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 17:37:55.109980 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-a284bdb2-1299-499c-9b3c-1ee70562bc29 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Flavor limits 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 17:37:55.110404 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-a284bdb2-1299-499c-9b3c-1ee70562bc29 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Image limits 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 17:37:55.110884 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-a284bdb2-1299-499c-9b3c-1ee70562bc29 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Flavor pref 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 17:37:55.111465 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-a284bdb2-1299-499c-9b3c-1ee70562bc29 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Image pref 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 17:37:55.111884 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-a284bdb2-1299-499c-9b3c-1ee70562bc29 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 17:37:55.121601 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a284bdb2-1299-499c-9b3c-1ee70562bc29 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:55.122047 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a284bdb2-1299-499c-9b3c-1ee70562bc29 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:55.122841 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a284bdb2-1299-499c-9b3c-1ee70562bc29 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:55.123273 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a284bdb2-1299-499c-9b3c-1ee70562bc29 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:55.145811 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-a284bdb2-1299-499c-9b3c-1ee70562bc29 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Getting quotas for project 9525b35792a04dc3a6f109cb39ee9d50. Resources: {'instances', 'cores', 'ram'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:37:55.150204 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-a284bdb2-1299-499c-9b3c-1ee70562bc29 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Getting quotas for user 7343386004e24474bc0af9126f47182b and project 9525b35792a04dc3a6f109cb39ee9d50. Resources: {'instances', 'cores', 'ram'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:37:55.164220 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a284bdb2-1299-499c-9b3c-1ee70562bc29 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Going to run 1 instances... {{(pid=117605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 17:37:55.167151 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a284bdb2-1299-499c-9b3c-1ee70562bc29 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: d5769834-1cb8-4e14-b39e-9b1f8e359553] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b2aab55c-a793-472a-bc32-81af689ad609',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 17:37:55.228762 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a284bdb2-1299-499c-9b3c-1ee70562bc29 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.751313 May 28 17:37:55.240147 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 567/1137] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 17:37:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 17:37:55.251874 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-de45659d-1eeb-4779-975f-600759ec9bc4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:55.252498 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-de45659d-1eeb-4779-975f-600759ec9bc4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: d5769834-1cb8-4e14-b39e-9b1f8e359553] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:55.320678 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-de45659d-1eeb-4779-975f-600759ec9bc4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:55.330044 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-de45659d-1eeb-4779-975f-600759ec9bc4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553" status: 200 len: 1242 microversion: 2.1 time: 0.083158 May 28 17:37:55.330938 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 571/1138] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:55 2022] GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:55.513752 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c42bcf15-ac17-423c-8e66-aaed06722064 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:55.514379 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c42bcf15-ac17-423c-8e66-aaed06722064 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] [instance: bee73b8a-aa12-4117-b567-bdb7d7e47f7d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:55.521959 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c42bcf15-ac17-423c-8e66-aaed06722064 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:55.522438 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c42bcf15-ac17-423c-8e66-aaed06722064 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:55.523468 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c42bcf15-ac17-423c-8e66-aaed06722064 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:55.523916 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c42bcf15-ac17-423c-8e66-aaed06722064 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:55.666803 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c42bcf15-ac17-423c-8e66-aaed06722064 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f2c92f417f42e6957bc97a27782092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f785fe1f5aea4aaaaac50187f1ef765a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:55.674535 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c42bcf15-ac17-423c-8e66-aaed06722064 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] 10.222.0.33 "GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d" status: 200 len: 1314 microversion: 2.1 time: 0.165155 May 28 17:37:55.675973 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 568/1139] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:55 2022] GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:56.348038 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-355f5665-74c1-425c-b454-aac8b960bedd tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:56.348643 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-355f5665-74c1-425c-b454-aac8b960bedd tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: d5769834-1cb8-4e14-b39e-9b1f8e359553] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:56.355030 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-355f5665-74c1-425c-b454-aac8b960bedd tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:56.355515 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-355f5665-74c1-425c-b454-aac8b960bedd tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:56.356277 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-355f5665-74c1-425c-b454-aac8b960bedd tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:56.356732 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-355f5665-74c1-425c-b454-aac8b960bedd tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:56.425946 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-355f5665-74c1-425c-b454-aac8b960bedd tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:56.443933 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-355f5665-74c1-425c-b454-aac8b960bedd tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553" status: 200 len: 1302 microversion: 2.1 time: 0.099593 May 28 17:37:56.446104 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 572/1140] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:56 2022] GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553 => generated 1302 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:56.693508 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d089252a-074d-470e-93d4-7e10fc78e361 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:56.694128 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d089252a-074d-470e-93d4-7e10fc78e361 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] [instance: bee73b8a-aa12-4117-b567-bdb7d7e47f7d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:56.700778 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d089252a-074d-470e-93d4-7e10fc78e361 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:56.701235 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d089252a-074d-470e-93d4-7e10fc78e361 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:56.702038 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d089252a-074d-470e-93d4-7e10fc78e361 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:56.702632 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d089252a-074d-470e-93d4-7e10fc78e361 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:56.908869 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d089252a-074d-470e-93d4-7e10fc78e361 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f2c92f417f42e6957bc97a27782092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f785fe1f5aea4aaaaac50187f1ef765a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:56.913550 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=100 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:37:56.918413 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d089252a-074d-470e-93d4-7e10fc78e361 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] 10.222.0.33 "GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d" status: 200 len: 1314 microversion: 2.1 time: 0.229702 May 28 17:37:56.919113 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 569/1141] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:56 2022] GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:57.462744 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d23b6139-7ba5-4ca6-ab93-d3b93a1b9b2c tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:57.463318 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d23b6139-7ba5-4ca6-ab93-d3b93a1b9b2c tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: d5769834-1cb8-4e14-b39e-9b1f8e359553] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:57.470203 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d23b6139-7ba5-4ca6-ab93-d3b93a1b9b2c tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:57.471577 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d23b6139-7ba5-4ca6-ab93-d3b93a1b9b2c tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:57.471577 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d23b6139-7ba5-4ca6-ab93-d3b93a1b9b2c tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:57.472493 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d23b6139-7ba5-4ca6-ab93-d3b93a1b9b2c tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:57.608699 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d23b6139-7ba5-4ca6-ab93-d3b93a1b9b2c tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:57.616111 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d23b6139-7ba5-4ca6-ab93-d3b93a1b9b2c tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553" status: 200 len: 1368 microversion: 2.1 time: 0.157382 May 28 17:37:57.616667 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 573/1142] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:57 2022] GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:57.924901 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-fff11688-e0cb-4c8a-9e8b-4622725c54e8 req-43fd889d-71c6-40c7-8da8-07208567ab0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bee73b8a-aa12-4117-b567-bdb7d7e47f7d", "name": "network-vif-plugged", "status": "completed", "tag": "d6d5750f-773b-493d-b7e7-f03eaa280fe2"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:37:57.936547 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8d39b4bc-fe6c-43b7-9569-3ee429891dda tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:57.937161 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8d39b4bc-fe6c-43b7-9569-3ee429891dda tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] [instance: bee73b8a-aa12-4117-b567-bdb7d7e47f7d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:57.946538 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8d39b4bc-fe6c-43b7-9569-3ee429891dda tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:57.952725 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8d39b4bc-fe6c-43b7-9569-3ee429891dda tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:57.953553 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8d39b4bc-fe6c-43b7-9569-3ee429891dda tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:57.953998 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8d39b4bc-fe6c-43b7-9569-3ee429891dda tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:57.957542 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-fff11688-e0cb-4c8a-9e8b-4622725c54e8 req-43fd889d-71c6-40c7-8da8-07208567ab0e service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:57.963614 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-fff11688-e0cb-4c8a-9e8b-4622725c54e8 req-43fd889d-71c6-40c7-8da8-07208567ab0e service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:57.979594 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-fff11688-e0cb-4c8a-9e8b-4622725c54e8 req-43fd889d-71c6-40c7-8da8-07208567ab0e service nova] Creating event network-vif-plugged:d6d5750f-773b-493d-b7e7-f03eaa280fe2 for instance bee73b8a-aa12-4117-b567-bdb7d7e47f7d on hv-cinder-84372 May 28 17:37:57.989437 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-fff11688-e0cb-4c8a-9e8b-4622725c54e8 req-43fd889d-71c6-40c7-8da8-07208567ab0e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068615 May 28 17:37:57.992415 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 570/1143] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:37:57.997666 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-ad7d2d56-b943-4ebe-a21d-f333568c1cf3 req-1d9a8b8d-5af2-4022-89b2-0880fa730622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5769834-1cb8-4e14-b39e-9b1f8e359553", "tag": "b7ee7236-7f4f-49a1-895b-3c97501aa1c1"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:37:58.007711 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-ad7d2d56-b943-4ebe-a21d-f333568c1cf3 req-1d9a8b8d-5af2-4022-89b2-0880fa730622 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:58.008163 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-ad7d2d56-b943-4ebe-a21d-f333568c1cf3 req-1d9a8b8d-5af2-4022-89b2-0880fa730622 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:58.033869 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-ad7d2d56-b943-4ebe-a21d-f333568c1cf3 req-1d9a8b8d-5af2-4022-89b2-0880fa730622 service nova] Creating event network-changed:b7ee7236-7f4f-49a1-895b-3c97501aa1c1 for instance d5769834-1cb8-4e14-b39e-9b1f8e359553 on hv-cinder-84372 May 28 17:37:58.052413 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-ad7d2d56-b943-4ebe-a21d-f333568c1cf3 req-1d9a8b8d-5af2-4022-89b2-0880fa730622 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058232 May 28 17:37:58.053410 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 571/1144] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:37:58.176454 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8d39b4bc-fe6c-43b7-9569-3ee429891dda tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f2c92f417f42e6957bc97a27782092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f785fe1f5aea4aaaaac50187f1ef765a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:58.184969 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8d39b4bc-fe6c-43b7-9569-3ee429891dda tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] 10.222.0.33 "GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d" status: 200 len: 1314 microversion: 2.1 time: 0.252434 May 28 17:37:58.185799 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 574/1145] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:57 2022] GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:58.634063 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-3f4e6814-cf23-465a-ab08-bc6fd48d7830 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:58.634687 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-3f4e6814-cf23-465a-ab08-bc6fd48d7830 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: d5769834-1cb8-4e14-b39e-9b1f8e359553] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:58.640899 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3f4e6814-cf23-465a-ab08-bc6fd48d7830 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:58.641348 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3f4e6814-cf23-465a-ab08-bc6fd48d7830 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:58.642110 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3f4e6814-cf23-465a-ab08-bc6fd48d7830 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:58.642549 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-3f4e6814-cf23-465a-ab08-bc6fd48d7830 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:58.826218 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-3f4e6814-cf23-465a-ab08-bc6fd48d7830 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:58.834185 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-3f4e6814-cf23-465a-ab08-bc6fd48d7830 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553" status: 200 len: 1368 microversion: 2.1 time: 0.204418 May 28 17:37:58.834752 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 572/1146] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:58 2022] GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553 => generated 1368 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:37:59.201780 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6bc35892-4ac5-4578-8ed4-3def05b7554b tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:59.202400 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6bc35892-4ac5-4578-8ed4-3def05b7554b tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] [instance: bee73b8a-aa12-4117-b567-bdb7d7e47f7d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:59.209508 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6bc35892-4ac5-4578-8ed4-3def05b7554b tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:59.209960 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6bc35892-4ac5-4578-8ed4-3def05b7554b tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:59.210734 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6bc35892-4ac5-4578-8ed4-3def05b7554b tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:59.211172 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6bc35892-4ac5-4578-8ed4-3def05b7554b tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:59.229026 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:37:59.345400 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-6bc35892-4ac5-4578-8ed4-3def05b7554b tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f2c92f417f42e6957bc97a27782092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f785fe1f5aea4aaaaac50187f1ef765a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:37:59.352902 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6bc35892-4ac5-4578-8ed4-3def05b7554b tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] 10.222.0.33 "GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d" status: 200 len: 1314 microversion: 2.1 time: 0.154936 May 28 17:37:59.353466 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 575/1147] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:59 2022] GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:37:59.851252 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-badd35e9-8854-4c3e-b8c3-2395677473c7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:37:59.851888 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-badd35e9-8854-4c3e-b8c3-2395677473c7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: d5769834-1cb8-4e14-b39e-9b1f8e359553] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:37:59.858342 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-badd35e9-8854-4c3e-b8c3-2395677473c7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:59.858787 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-badd35e9-8854-4c3e-b8c3-2395677473c7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:59.859565 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-badd35e9-8854-4c3e-b8c3-2395677473c7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:37:59.859997 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-badd35e9-8854-4c3e-b8c3-2395677473c7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:37:59.996039 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-badd35e9-8854-4c3e-b8c3-2395677473c7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:38:00.003602 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-badd35e9-8854-4c3e-b8c3-2395677473c7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553" status: 200 len: 1368 microversion: 2.1 time: 0.156783 May 28 17:38:00.004160 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 573/1148] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:37:59 2022] GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:38:00.370586 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-095c65ca-5f36-481f-93c1-a22f6c71ad33 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:38:00.371200 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-095c65ca-5f36-481f-93c1-a22f6c71ad33 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] [instance: bee73b8a-aa12-4117-b567-bdb7d7e47f7d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:38:00.387642 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-095c65ca-5f36-481f-93c1-a22f6c71ad33 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:00.388090 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-095c65ca-5f36-481f-93c1-a22f6c71ad33 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:00.388906 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-095c65ca-5f36-481f-93c1-a22f6c71ad33 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:00.389347 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-095c65ca-5f36-481f-93c1-a22f6c71ad33 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:00.516371 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-095c65ca-5f36-481f-93c1-a22f6c71ad33 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f2c92f417f42e6957bc97a27782092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f785fe1f5aea4aaaaac50187f1ef765a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:38:00.524317 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-095c65ca-5f36-481f-93c1-a22f6c71ad33 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] 10.222.0.33 "GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d" status: 200 len: 1314 microversion: 2.1 time: 0.157914 May 28 17:38:00.524873 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 576/1149] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:38:00 2022] GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:38:01.019661 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5397f889-2eea-42d9-982b-3bed4a6c1679 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:38:01.020206 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5397f889-2eea-42d9-982b-3bed4a6c1679 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: d5769834-1cb8-4e14-b39e-9b1f8e359553] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:38:01.026645 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5397f889-2eea-42d9-982b-3bed4a6c1679 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:01.027087 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5397f889-2eea-42d9-982b-3bed4a6c1679 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:01.027871 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5397f889-2eea-42d9-982b-3bed4a6c1679 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:01.028305 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5397f889-2eea-42d9-982b-3bed4a6c1679 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:01.161396 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-5397f889-2eea-42d9-982b-3bed4a6c1679 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:38:01.170370 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5397f889-2eea-42d9-982b-3bed4a6c1679 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553" status: 200 len: 1368 microversion: 2.1 time: 0.154632 May 28 17:38:01.171131 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 574/1150] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:38:01 2022] GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:38:01.540271 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-65055b06-cc55-4ff5-8f88-9b62bb6825c0 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:38:01.540806 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-65055b06-cc55-4ff5-8f88-9b62bb6825c0 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] [instance: bee73b8a-aa12-4117-b567-bdb7d7e47f7d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:38:01.547084 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-65055b06-cc55-4ff5-8f88-9b62bb6825c0 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:01.547561 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-65055b06-cc55-4ff5-8f88-9b62bb6825c0 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:01.548315 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-65055b06-cc55-4ff5-8f88-9b62bb6825c0 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:01.548746 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-65055b06-cc55-4ff5-8f88-9b62bb6825c0 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:01.689519 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-65055b06-cc55-4ff5-8f88-9b62bb6825c0 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f2c92f417f42e6957bc97a27782092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f785fe1f5aea4aaaaac50187f1ef765a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:38:01.697597 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-65055b06-cc55-4ff5-8f88-9b62bb6825c0 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] 10.222.0.33 "GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d" status: 200 len: 1314 microversion: 2.1 time: 0.161079 May 28 17:38:01.698471 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 577/1151] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:38:01 2022] GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:38:02.188429 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-62f40892-0eb7-45d6-8559-3d9d37d1d9c1 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:38:02.189612 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-62f40892-0eb7-45d6-8559-3d9d37d1d9c1 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: d5769834-1cb8-4e14-b39e-9b1f8e359553] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:38:02.198014 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-62f40892-0eb7-45d6-8559-3d9d37d1d9c1 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:02.199307 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-62f40892-0eb7-45d6-8559-3d9d37d1d9c1 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:02.200408 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-62f40892-0eb7-45d6-8559-3d9d37d1d9c1 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:02.200874 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-62f40892-0eb7-45d6-8559-3d9d37d1d9c1 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:02.334096 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-62f40892-0eb7-45d6-8559-3d9d37d1d9c1 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:38:02.341509 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-62f40892-0eb7-45d6-8559-3d9d37d1d9c1 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553" status: 200 len: 1368 microversion: 2.1 time: 0.156986 May 28 17:38:02.342076 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 575/1152] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:38:02 2022] GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:38:02.715615 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-3f241c52-427d-4904-b9f9-2dc13a6be6a5 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:38:02.717009 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-3f241c52-427d-4904-b9f9-2dc13a6be6a5 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] [instance: bee73b8a-aa12-4117-b567-bdb7d7e47f7d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:38:02.725833 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3f241c52-427d-4904-b9f9-2dc13a6be6a5 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:02.726386 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3f241c52-427d-4904-b9f9-2dc13a6be6a5 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:02.727234 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3f241c52-427d-4904-b9f9-2dc13a6be6a5 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:02.727769 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-3f241c52-427d-4904-b9f9-2dc13a6be6a5 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:02.877367 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-3f241c52-427d-4904-b9f9-2dc13a6be6a5 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f2c92f417f42e6957bc97a27782092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f785fe1f5aea4aaaaac50187f1ef765a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:38:02.886987 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-3f241c52-427d-4904-b9f9-2dc13a6be6a5 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] 10.222.0.33 "GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d" status: 200 len: 1464 microversion: 2.1 time: 0.175322 May 28 17:38:02.899509 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 578/1153] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:38:02 2022] GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d => generated 1464 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:38:02.934723 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9ce45117-5bed-42f1-acf5-2ad2e2eff6bc tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:38:02.935225 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9ce45117-5bed-42f1-acf5-2ad2e2eff6bc tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] [instance: bee73b8a-aa12-4117-b567-bdb7d7e47f7d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:38:02.941676 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9ce45117-5bed-42f1-acf5-2ad2e2eff6bc tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:02.942132 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9ce45117-5bed-42f1-acf5-2ad2e2eff6bc tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:02.942904 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9ce45117-5bed-42f1-acf5-2ad2e2eff6bc tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:02.943375 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9ce45117-5bed-42f1-acf5-2ad2e2eff6bc tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:02.969504 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9ce45117-5bed-42f1-acf5-2ad2e2eff6bc tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] [instance: bee73b8a-aa12-4117-b567-bdb7d7e47f7d] Going to try to terminate instance {{(pid=117605) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 17:38:03.052356 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9ce45117-5bed-42f1-acf5-2ad2e2eff6bc tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d" status: 204 len: 0 microversion: 2.1 time: 0.121022 May 28 17:38:03.056549 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 576/1154] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 17:38:02 2022] DELETE /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 17:38:03.062308 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c5aae5e5-f087-4f08-83e2-51d8a5bdccee tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:38:03.063050 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c5aae5e5-f087-4f08-83e2-51d8a5bdccee tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] [instance: bee73b8a-aa12-4117-b567-bdb7d7e47f7d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:38:03.070343 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c5aae5e5-f087-4f08-83e2-51d8a5bdccee tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:03.070798 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c5aae5e5-f087-4f08-83e2-51d8a5bdccee tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:03.071637 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c5aae5e5-f087-4f08-83e2-51d8a5bdccee tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:03.072115 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c5aae5e5-f087-4f08-83e2-51d8a5bdccee tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:03.209338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c5aae5e5-f087-4f08-83e2-51d8a5bdccee tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f2c92f417f42e6957bc97a27782092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f785fe1f5aea4aaaaac50187f1ef765a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:38:03.216937 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c5aae5e5-f087-4f08-83e2-51d8a5bdccee tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] 10.222.0.33 "GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d" status: 200 len: 1470 microversion: 2.1 time: 0.158638 May 28 17:38:03.217506 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 579/1155] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:38:03 2022] GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:38:03.358599 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7cccf60b-54f3-4afe-81cc-ac16819e9a21 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:38:03.359296 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7cccf60b-54f3-4afe-81cc-ac16819e9a21 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: d5769834-1cb8-4e14-b39e-9b1f8e359553] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:38:03.365723 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7cccf60b-54f3-4afe-81cc-ac16819e9a21 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:03.366170 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7cccf60b-54f3-4afe-81cc-ac16819e9a21 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:03.366918 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7cccf60b-54f3-4afe-81cc-ac16819e9a21 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:03.367363 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7cccf60b-54f3-4afe-81cc-ac16819e9a21 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:03.497598 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7cccf60b-54f3-4afe-81cc-ac16819e9a21 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:38:03.505818 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7cccf60b-54f3-4afe-81cc-ac16819e9a21 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553" status: 200 len: 1368 microversion: 2.1 time: 0.151510 May 28 17:38:03.506386 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 577/1156] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:38:03 2022] GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:38:04.235203 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1505a0ae-4dc5-4728-94fc-0abdf4e04b41 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:38:04.235849 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1505a0ae-4dc5-4728-94fc-0abdf4e04b41 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] [instance: bee73b8a-aa12-4117-b567-bdb7d7e47f7d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:38:04.243486 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1505a0ae-4dc5-4728-94fc-0abdf4e04b41 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:04.243930 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1505a0ae-4dc5-4728-94fc-0abdf4e04b41 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:04.244768 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1505a0ae-4dc5-4728-94fc-0abdf4e04b41 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:04.245195 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1505a0ae-4dc5-4728-94fc-0abdf4e04b41 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:04.383479 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1505a0ae-4dc5-4728-94fc-0abdf4e04b41 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f2c92f417f42e6957bc97a27782092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f785fe1f5aea4aaaaac50187f1ef765a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:38:04.390866 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1505a0ae-4dc5-4728-94fc-0abdf4e04b41 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] 10.222.0.33 "GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d" status: 200 len: 1470 microversion: 2.1 time: 0.159530 May 28 17:38:04.400084 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 580/1157] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:38:04 2022] GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:38:04.522164 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-cf18c177-cb93-491d-9f3e-4c44602a0fca tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:38:04.522839 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-cf18c177-cb93-491d-9f3e-4c44602a0fca tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: d5769834-1cb8-4e14-b39e-9b1f8e359553] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:38:04.529488 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cf18c177-cb93-491d-9f3e-4c44602a0fca tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:04.529943 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cf18c177-cb93-491d-9f3e-4c44602a0fca tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:04.530715 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cf18c177-cb93-491d-9f3e-4c44602a0fca tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:04.531153 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cf18c177-cb93-491d-9f3e-4c44602a0fca tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:04.657107 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-cf18c177-cb93-491d-9f3e-4c44602a0fca tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:38:04.665099 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-cf18c177-cb93-491d-9f3e-4c44602a0fca tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553" status: 200 len: 1368 microversion: 2.1 time: 0.146923 May 28 17:38:04.665659 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 578/1158] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:38:04 2022] GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:38:05.255642 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-f82ad67d-4926-4f44-86b4-8e9e60c9015e req-bd556831-9185-4f28-9243-64e89e345cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bee73b8a-aa12-4117-b567-bdb7d7e47f7d", "name": "network-vif-deleted", "tag": "d6d5750f-773b-493d-b7e7-f03eaa280fe2"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:38:05.264639 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-f82ad67d-4926-4f44-86b4-8e9e60c9015e req-bd556831-9185-4f28-9243-64e89e345cc3 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:05.265065 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-f82ad67d-4926-4f44-86b4-8e9e60c9015e req-bd556831-9185-4f28-9243-64e89e345cc3 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:05.277195 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-f82ad67d-4926-4f44-86b4-8e9e60c9015e req-bd556831-9185-4f28-9243-64e89e345cc3 service nova] Creating event network-vif-deleted:d6d5750f-773b-493d-b7e7-f03eaa280fe2 for instance bee73b8a-aa12-4117-b567-bdb7d7e47f7d on hv-cinder-84372 May 28 17:38:05.282558 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-f82ad67d-4926-4f44-86b4-8e9e60c9015e req-bd556831-9185-4f28-9243-64e89e345cc3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031167 May 28 17:38:05.283519 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 581/1159] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:38:05.408999 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2c13bc8c-c0ba-4ab8-a579-f36108cc78d9 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:38:05.410377 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2c13bc8c-c0ba-4ab8-a579-f36108cc78d9 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] [instance: bee73b8a-aa12-4117-b567-bdb7d7e47f7d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:38:05.412378 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=4 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:38:05.413054 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=18 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:38:05.418057 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2c13bc8c-c0ba-4ab8-a579-f36108cc78d9 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:05.418710 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2c13bc8c-c0ba-4ab8-a579-f36108cc78d9 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:05.419520 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2c13bc8c-c0ba-4ab8-a579-f36108cc78d9 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:05.419958 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2c13bc8c-c0ba-4ab8-a579-f36108cc78d9 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:05.456407 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2c13bc8c-c0ba-4ab8-a579-f36108cc78d9 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:05.457213 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2c13bc8c-c0ba-4ab8-a579-f36108cc78d9 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:05.457936 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.objects.instance [None req-2c13bc8c-c0ba-4ab8-a579-f36108cc78d9 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lazy-loading 'fault' on Instance uuid bee73b8a-aa12-4117-b567-bdb7d7e47f7d {{(pid=117605) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 17:38:05.507800 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2c13bc8c-c0ba-4ab8-a579-f36108cc78d9 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f2c92f417f42e6957bc97a27782092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f785fe1f5aea4aaaaac50187f1ef765a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:38:05.515262 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2c13bc8c-c0ba-4ab8-a579-f36108cc78d9 tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] 10.222.0.33 "GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d" status: 200 len: 1304 microversion: 2.1 time: 0.110230 May 28 17:38:05.515852 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 579/1160] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:38:05 2022] GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:38:05.679038 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:38:05.683180 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-716ab3b8-2f46-4bd1-88b9-7be3c4c96098 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:38:05.683901 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-716ab3b8-2f46-4bd1-88b9-7be3c4c96098 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: d5769834-1cb8-4e14-b39e-9b1f8e359553] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:38:05.690343 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-716ab3b8-2f46-4bd1-88b9-7be3c4c96098 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:05.691188 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-716ab3b8-2f46-4bd1-88b9-7be3c4c96098 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:05.691978 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-716ab3b8-2f46-4bd1-88b9-7be3c4c96098 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:05.692409 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-716ab3b8-2f46-4bd1-88b9-7be3c4c96098 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:05.851487 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-716ab3b8-2f46-4bd1-88b9-7be3c4c96098 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:38:05.859141 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-716ab3b8-2f46-4bd1-88b9-7be3c4c96098 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553" status: 200 len: 1368 microversion: 2.1 time: 0.180953 May 28 17:38:05.859737 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 582/1161] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:38:05 2022] GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553 => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:38:05.920681 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-9c7f9d4b-9473-4f31-b8ab-ee6af3e61b2b req-50ceefba-fb33-4172-810d-082ce5ed2690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5769834-1cb8-4e14-b39e-9b1f8e359553", "name": "network-vif-plugged", "status": "completed", "tag": "b7ee7236-7f4f-49a1-895b-3c97501aa1c1"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:38:05.929536 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-9c7f9d4b-9473-4f31-b8ab-ee6af3e61b2b req-50ceefba-fb33-4172-810d-082ce5ed2690 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:05.930074 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-9c7f9d4b-9473-4f31-b8ab-ee6af3e61b2b req-50ceefba-fb33-4172-810d-082ce5ed2690 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:05.941815 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-9c7f9d4b-9473-4f31-b8ab-ee6af3e61b2b req-50ceefba-fb33-4172-810d-082ce5ed2690 service nova] Creating event network-vif-plugged:b7ee7236-7f4f-49a1-895b-3c97501aa1c1 for instance d5769834-1cb8-4e14-b39e-9b1f8e359553 on hv-cinder-84372 May 28 17:38:05.946522 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-9c7f9d4b-9473-4f31-b8ab-ee6af3e61b2b req-50ceefba-fb33-4172-810d-082ce5ed2690 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030064 May 28 17:38:05.947267 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 580/1162] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:38:06.532627 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6daf09ed-8bbd-4651-9f50-38ebe1d5398e tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:38:06.533244 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6daf09ed-8bbd-4651-9f50-38ebe1d5398e tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] [instance: bee73b8a-aa12-4117-b567-bdb7d7e47f7d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:38:06.540153 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6daf09ed-8bbd-4651-9f50-38ebe1d5398e tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:06.540599 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6daf09ed-8bbd-4651-9f50-38ebe1d5398e tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:06.541361 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6daf09ed-8bbd-4651-9f50-38ebe1d5398e tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:06.541792 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6daf09ed-8bbd-4651-9f50-38ebe1d5398e tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:06.555661 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-6daf09ed-8bbd-4651-9f50-38ebe1d5398e tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] HTTP exception thrown: Instance bee73b8a-aa12-4117-b567-bdb7d7e47f7d could not be found. May 28 17:38:06.557305 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6daf09ed-8bbd-4651-9f50-38ebe1d5398e tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Request method failure captured: May 28 17:38:06.557305 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d HTTP/1.1 May 28 17:38:06.557305 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:38:06.557305 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:38:06.557305 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:38:06.557305 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 0 May 28 17:38:06.557305 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:38:06.557305 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:38:06.557305 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:38:06.557305 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:38:06.557305 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABikl3phnCEV4Ia1kAV5_iHBCkp3AYWG880GY3SRpqr8BmAL8CdA5AQpWrUd3eT1zxBBxAYi-__h17rcnyCa_KNAriR35TeFKreef65qN2ODL5eAT5CSfPlXSmlguiyxyv1pbZA5wvBtqTMaYG1PAJIrja2i0JjqTWG75g6-aYRgFO3m6M May 28 17:38:06.557305 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:38:06.557305 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:38:06.557305 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:38:06.557305 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:38:06.557305 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:38:06.557305 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:38:06.557305 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: f785fe1f5aea4aaaaac50187f1ef765a May 28 17:38:06.557305 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-VolumesNegativeTest-79617155 May 28 17:38:06.557305 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:38:06.557305 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:38:06.559008 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f785fe1f5aea4aaaaac50187f1ef765a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f785fe1f5aea4aaaaac50187f1ef765a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f785fe1f5aea4aaaaac50187f1ef765a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f785fe1f5aea4aaaaac50187f1ef765a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:38:06.559008 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-VolumesNegativeTest-79617155 May 28 17:38:06.559008 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: f785fe1f5aea4aaaaac50187f1ef765a May 28 17:38:06.559008 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-VolumesNegativeTest-79617155 May 28 17:38:06.559008 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-VolumesNegativeTest-79617155-project May 28 17:38:06.559008 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:38:06.559008 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:38:06.559008 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: 89f2c92f417f42e6957bc97a27782092 May 28 17:38:06.559008 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-VolumesNegativeTest-79617155-project May 28 17:38:06.559008 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: > May 28 17:38:06.559008 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Instance bee73b8a-aa12-4117-b567-bdb7d7e47f7d could not be found. May 28 17:38:06.559008 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'id': 'bee73b8a-aa12-4117-b567-bdb7d7e47f7d'} May 28 17:38:06.560418 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:38:06.560418 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:38:06.560418 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:38:06.560418 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:38:06.560418 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:38:06.560418 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:38:06.560418 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:38:06.560418 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:38:06.560418 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:38:06.560418 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:38:06.560418 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bee73b8a-aa12-4117-b567-bdb7d7e47f7d could not be found. May 28 17:38:06.560418 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:38:06.560418 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:38:06.560418 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:38:06.560418 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:38:06.560418 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:38:06.560418 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:38:06.560418 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:38:06.560418 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:38:06.560418 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:38:06.561911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:38:06.561911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:38:06.561911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:38:06.561911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:38:06.561911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:38:06.561911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:38:06.561911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:38:06.561911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bee73b8a-aa12-4117-b567-bdb7d7e47f7d could not be found. May 28 17:38:06.561911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:38:06.561911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:38:06.561911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:38:06.561911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:38:06.561911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:38:06.561911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:38:06.561911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:38:06.561911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:38:06.561911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bee73b8a-aa12-4117-b567-bdb7d7e47f7d could not be found. May 28 17:38:06.561911 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:38:06.563208 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6daf09ed-8bbd-4651-9f50-38ebe1d5398e tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] Returning 404 to user: Instance bee73b8a-aa12-4117-b567-bdb7d7e47f7d could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:38:06.563208 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6daf09ed-8bbd-4651-9f50-38ebe1d5398e tempest-VolumesNegativeTest-79617155 tempest-VolumesNegativeTest-79617155-project] 10.222.0.33 "GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d" status: 404 len: 111 microversion: 2.1 time: 0.029881 May 28 17:38:06.563208 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 583/1163] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:38:06 2022] GET /compute/v2.1/servers/bee73b8a-aa12-4117-b567-bdb7d7e47f7d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:38:06.878122 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-424c23d3-d9d9-4930-bd48-44a148c481d7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:38:06.879859 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-424c23d3-d9d9-4930-bd48-44a148c481d7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: d5769834-1cb8-4e14-b39e-9b1f8e359553] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:38:06.886139 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-424c23d3-d9d9-4930-bd48-44a148c481d7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:06.886638 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-424c23d3-d9d9-4930-bd48-44a148c481d7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:06.887362 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-424c23d3-d9d9-4930-bd48-44a148c481d7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:06.887815 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-424c23d3-d9d9-4930-bd48-44a148c481d7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:07.039858 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-424c23d3-d9d9-4930-bd48-44a148c481d7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:38:07.048725 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-424c23d3-d9d9-4930-bd48-44a148c481d7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553" status: 200 len: 1368 microversion: 2.1 time: 0.175202 May 28 17:38:07.049382 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 581/1164] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:38:06 2022] GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553 => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:38:08.067081 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-b4e54a02-af8d-4d23-93d9-0d72fc879c66 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:38:08.068580 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-b4e54a02-af8d-4d23-93d9-0d72fc879c66 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: d5769834-1cb8-4e14-b39e-9b1f8e359553] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:38:08.078176 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b4e54a02-af8d-4d23-93d9-0d72fc879c66 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:08.082457 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b4e54a02-af8d-4d23-93d9-0d72fc879c66 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:08.083291 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b4e54a02-af8d-4d23-93d9-0d72fc879c66 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:08.083762 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-b4e54a02-af8d-4d23-93d9-0d72fc879c66 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:08.263583 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-b4e54a02-af8d-4d23-93d9-0d72fc879c66 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:38:08.272163 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-b4e54a02-af8d-4d23-93d9-0d72fc879c66 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553" status: 200 len: 1558 microversion: 2.1 time: 0.209595 May 28 17:38:08.272726 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 584/1165] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:38:08 2022] GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553 => generated 1558 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:38:08.289375 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-5010c218-91a1-4cd1-9cde-cd89004701b8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:38:08.290150 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-5010c218-91a1-4cd1-9cde-cd89004701b8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: d5769834-1cb8-4e14-b39e-9b1f8e359553] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:38:08.296876 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5010c218-91a1-4cd1-9cde-cd89004701b8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:08.297324 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5010c218-91a1-4cd1-9cde-cd89004701b8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:08.298086 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5010c218-91a1-4cd1-9cde-cd89004701b8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:08.298524 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-5010c218-91a1-4cd1-9cde-cd89004701b8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:08.381802 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-5010c218-91a1-4cd1-9cde-cd89004701b8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096302 May 28 17:38:08.382419 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 582/1166] 10.222.0.33 () {58 vars in 1274 bytes} [Sat May 28 17:38:08 2022] GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:38:09.641462 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-d340e526-be3a-43f0-b129-92dd5dfc2bd1 req-099190e3-f3b3-4c9a-a915-6421b0036661 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5769834-1cb8-4e14-b39e-9b1f8e359553", "tag": "b7ee7236-7f4f-49a1-895b-3c97501aa1c1"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:38:09.652712 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-d340e526-be3a-43f0-b129-92dd5dfc2bd1 req-099190e3-f3b3-4c9a-a915-6421b0036661 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:38:09.653159 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-d340e526-be3a-43f0-b129-92dd5dfc2bd1 req-099190e3-f3b3-4c9a-a915-6421b0036661 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:38:09.665082 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-d340e526-be3a-43f0-b129-92dd5dfc2bd1 req-099190e3-f3b3-4c9a-a915-6421b0036661 service nova] Creating event network-changed:b7ee7236-7f4f-49a1-895b-3c97501aa1c1 for instance d5769834-1cb8-4e14-b39e-9b1f8e359553 on hv-cinder-84372 May 28 17:38:09.669870 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-d340e526-be3a-43f0-b129-92dd5dfc2bd1 req-099190e3-f3b3-4c9a-a915-6421b0036661 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032089 May 28 17:38:09.670619 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 585/1167] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 17:39:24.609101 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:39:24.609845 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:39:24.827684 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c5ed1b9d-ee1b-4c17-8dca-14fc1b7a7f27 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:39:24.828187 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c5ed1b9d-ee1b-4c17-8dca-14fc1b7a7f27 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: d5769834-1cb8-4e14-b39e-9b1f8e359553] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:39:24.834340 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c5ed1b9d-ee1b-4c17-8dca-14fc1b7a7f27 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:24.834784 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c5ed1b9d-ee1b-4c17-8dca-14fc1b7a7f27 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:24.835566 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c5ed1b9d-ee1b-4c17-8dca-14fc1b7a7f27 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:24.835997 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c5ed1b9d-ee1b-4c17-8dca-14fc1b7a7f27 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:24.858911 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c5ed1b9d-ee1b-4c17-8dca-14fc1b7a7f27 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553/ips" status: 200 len: 149 microversion: 2.1 time: 0.252087 May 28 17:39:24.859487 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 583/1168] 10.222.0.33 () {58 vars in 1247 bytes} [Sat May 28 17:39:24 2022] GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553/ips => generated 149 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:39:26.172924 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:39:26.173730 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=50 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:39:26.179293 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-70b9880c-b0dd-4e41-8c46-a1e81a267c5d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd99e9e2-c38d-422a-9617-08914d5f5fdc"}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:39:26.180470 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-70b9880c-b0dd-4e41-8c46-a1e81a267c5d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: d5769834-1cb8-4e14-b39e-9b1f8e359553] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:39:26.188288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-70b9880c-b0dd-4e41-8c46-a1e81a267c5d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:26.188738 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-70b9880c-b0dd-4e41-8c46-a1e81a267c5d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:26.189499 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-70b9880c-b0dd-4e41-8c46-a1e81a267c5d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:26.189937 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-70b9880c-b0dd-4e41-8c46-a1e81a267c5d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:26.443905 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-70b9880c-b0dd-4e41-8c46-a1e81a267c5d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "POST /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272879 May 28 17:39:26.444539 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 586/1169] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 17:39:26 2022] POST /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:39:33.939170 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c3f9b6a9-3de4-4e5b-9f10-ae8ca26505ad tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd99e9e2-c38d-422a-9617-08914d5f5fdc"}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:39:33.940320 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c3f9b6a9-3de4-4e5b-9f10-ae8ca26505ad tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: d5769834-1cb8-4e14-b39e-9b1f8e359553] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:39:33.947374 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c3f9b6a9-3de4-4e5b-9f10-ae8ca26505ad tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:33.947837 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c3f9b6a9-3de4-4e5b-9f10-ae8ca26505ad tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:33.948599 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c3f9b6a9-3de4-4e5b-9f10-ae8ca26505ad tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:33.949048 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c3f9b6a9-3de4-4e5b-9f10-ae8ca26505ad tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:34.027077 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-c3f9b6a9-3de4-4e5b-9f10-ae8ca26505ad tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] HTTP exception thrown: Invalid volume: volume dd99e9e2-c38d-422a-9617-08914d5f5fdc is already attached to instances: d5769834-1cb8-4e14-b39e-9b1f8e359553 May 28 17:39:34.028880 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c3f9b6a9-3de4-4e5b-9f10-ae8ca26505ad tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Request method failure captured: May 28 17:39:34.028880 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: request: POST /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553/os-volume_attachments HTTP/1.1 May 28 17:39:34.028880 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept: application/json May 28 17:39:34.028880 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity May 28 17:39:34.028880 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Connection: close May 28 17:39:34.028880 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Length: 74 May 28 17:39:34.028880 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Type: application/json May 28 17:39:34.028880 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 May 28 17:39:34.028880 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None May 28 17:39:34.028880 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 May 28 17:39:34.028880 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABiklztpzsrcs87QXRJpScgk-5tUukjwPy1pG5nwYCeqw-1TdfbNHEPQv0dxfORMmAI_huWNfz4S1kkPQDKvHAPGaV0itPNNhduphbnIQQ9CdIotGmgnrod8uAS5LCp8f9bs3_RlkUgWcVbaRmZwj6AERxTjQmBOF2VAsv1p_k3m3IU8vI May 28 17:39:34.028880 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Id: None May 28 17:39:34.028880 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Name: None May 28 17:39:34.028880 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed May 28 17:39:34.028880 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True May 28 17:39:34.028880 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default May 28 17:39:34.028880 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default May 28 17:39:34.028880 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Id: 9525b35792a04dc3a6f109cb39ee9d50 May 28 17:39:34.028880 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:39:34.028880 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Role: reader,member May 28 17:39:34.028880 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Roles: reader,member May 28 17:39:34.030679 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9525b35792a04dc3a6f109cb39ee9d50", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:39:34.030679 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:39:34.030679 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 9525b35792a04dc3a6f109cb39ee9d50 May 28 17:39:34.030679 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:39:34.030679 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeNegativeTest-1796155594-project May 28 17:39:34.030679 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default May 28 17:39:34.030679 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default May 28 17:39:34.030679 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Id: 7343386004e24474bc0af9126f47182b May 28 17:39:34.030679 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeNegativeTest-1796155594-project May 28 17:39:34.030679 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: May 28 17:39:34.030679 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: {"volumeAttachment": {"volumeId": "dd99e9e2-c38d-422a-9617-08914d5f5fdc"}} May 28 17:39:34.030679 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: method: > May 28 17:39:34.031734 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: exception: Invalid volume: volume dd99e9e2-c38d-422a-9617-08914d5f5fdc is already attached to instances: d5769834-1cb8-4e14-b39e-9b1f8e359553 May 28 17:39:34.031734 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: action_args: {'server_id': 'd5769834-1cb8-4e14-b39e-9b1f8e359553', 'body': {'volumeAttachment': {'volumeId': 'dd99e9e2-c38d-422a-9617-08914d5f5fdc'}}} May 28 17:39:34.031734 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:39:34.031734 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:39:34.031734 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 28 17:39:34.031734 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 28 17:39:34.031734 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 17:39:34.031734 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 17:39:34.031734 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 28 17:39:34.031734 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 17:39:34.031734 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 28 17:39:34.031734 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 28 17:39:34.031734 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 28 17:39:34.031734 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 28 17:39:34.031734 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume dd99e9e2-c38d-422a-9617-08914d5f5fdc is already attached to instances: d5769834-1cb8-4e14-b39e-9b1f8e359553 May 28 17:39:34.031734 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:39:34.031734 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:39:34.031734 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:39:34.031734 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:39:34.033260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:39:34.033260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:39:34.033260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:39:34.033260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:39:34.033260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:39:34.033260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:39:34.033260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 17:39:34.033260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 17:39:34.033260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 17:39:34.033260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 17:39:34.033260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 17:39:34.033260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 17:39:34.033260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 28 17:39:34.033260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 28 17:39:34.033260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume dd99e9e2-c38d-422a-9617-08914d5f5fdc is already attached to instances: d5769834-1cb8-4e14-b39e-9b1f8e359553 May 28 17:39:34.033260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:39:34.033260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:39:34.033260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:39:34.033260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:39:34.033260 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:39:34.034978 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:39:34.034978 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:39:34.034978 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:39:34.034978 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume dd99e9e2-c38d-422a-9617-08914d5f5fdc is already attached to instances: d5769834-1cb8-4e14-b39e-9b1f8e359553 May 28 17:39:34.034978 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:39:34.034978 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c3f9b6a9-3de4-4e5b-9f10-ae8ca26505ad tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Returning 400 to user: Invalid volume: volume dd99e9e2-c38d-422a-9617-08914d5f5fdc is already attached to instances: d5769834-1cb8-4e14-b39e-9b1f8e359553 {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:39:34.034978 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c3f9b6a9-3de4-4e5b-9f10-ae8ca26505ad tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "POST /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095128 May 28 17:39:34.034978 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 584/1170] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 17:39:33 2022] POST /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 17:39:34.095785 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-46bec790-5d21-4a78-989d-4b25570f2fe4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:39:34.096348 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-46bec790-5d21-4a78-989d-4b25570f2fe4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: d5769834-1cb8-4e14-b39e-9b1f8e359553] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:39:34.102748 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-46bec790-5d21-4a78-989d-4b25570f2fe4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:34.103195 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-46bec790-5d21-4a78-989d-4b25570f2fe4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:34.103992 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-46bec790-5d21-4a78-989d-4b25570f2fe4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:34.104438 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-46bec790-5d21-4a78-989d-4b25570f2fe4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:34.185084 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-46bec790-5d21-4a78-989d-4b25570f2fe4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lazy-loading 'services' on Instance uuid d5769834-1cb8-4e14-b39e-9b1f8e359553 {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 17:39:34.257609 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-46bec790-5d21-4a78-989d-4b25570f2fe4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553/os-volume_attachments/dd99e9e2-c38d-422a-9617-08914d5f5fdc" status: 202 len: 0 microversion: 2.1 time: 0.166409 May 28 17:39:34.258193 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 587/1171] 10.222.0.33 () {58 vars in 1415 bytes} [Sat May 28 17:39:34 2022] DELETE /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553/os-volume_attachments/dd99e9e2-c38d-422a-9617-08914d5f5fdc => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 17:39:34.266545 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7f454e12-f6aa-42eb-9494-e29de1772c84 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:39:34.267511 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7f454e12-f6aa-42eb-9494-e29de1772c84 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: d5769834-1cb8-4e14-b39e-9b1f8e359553] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:39:34.274299 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7f454e12-f6aa-42eb-9494-e29de1772c84 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:34.274747 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7f454e12-f6aa-42eb-9494-e29de1772c84 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:34.275750 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7f454e12-f6aa-42eb-9494-e29de1772c84 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:34.276192 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7f454e12-f6aa-42eb-9494-e29de1772c84 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:34.307168 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7f454e12-f6aa-42eb-9494-e29de1772c84 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044505 May 28 17:39:34.307768 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 585/1172] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 17:39:34 2022] GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:39:35.321292 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-97c90ae8-79ab-43ff-a403-d1ba21d6f67f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:39:35.322358 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-97c90ae8-79ab-43ff-a403-d1ba21d6f67f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: d5769834-1cb8-4e14-b39e-9b1f8e359553] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:39:35.328627 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-97c90ae8-79ab-43ff-a403-d1ba21d6f67f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:35.329226 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-97c90ae8-79ab-43ff-a403-d1ba21d6f67f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:35.330197 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-97c90ae8-79ab-43ff-a403-d1ba21d6f67f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:35.330413 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-97c90ae8-79ab-43ff-a403-d1ba21d6f67f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:35.358962 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-97c90ae8-79ab-43ff-a403-d1ba21d6f67f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042940 May 28 17:39:35.359454 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 588/1173] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 17:39:35 2022] GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 17:39:35.418485 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-501d0bae-7a24-4e43-949a-60bff2ea29eb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:39:35.419008 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-501d0bae-7a24-4e43-949a-60bff2ea29eb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: d5769834-1cb8-4e14-b39e-9b1f8e359553] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:39:35.425541 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-501d0bae-7a24-4e43-949a-60bff2ea29eb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:35.425985 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-501d0bae-7a24-4e43-949a-60bff2ea29eb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:35.426747 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-501d0bae-7a24-4e43-949a-60bff2ea29eb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:35.427203 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-501d0bae-7a24-4e43-949a-60bff2ea29eb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:35.453729 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-501d0bae-7a24-4e43-949a-60bff2ea29eb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: d5769834-1cb8-4e14-b39e-9b1f8e359553] Going to try to terminate instance {{(pid=117605) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 17:39:35.528763 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-501d0bae-7a24-4e43-949a-60bff2ea29eb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553" status: 204 len: 0 microversion: 2.1 time: 0.113829 May 28 17:39:35.529331 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 586/1174] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 17:39:35 2022] DELETE /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 17:39:35.537626 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-7b41a56f-cd80-40b4-9480-81f8df3d630f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:39:35.538324 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-7b41a56f-cd80-40b4-9480-81f8df3d630f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: d5769834-1cb8-4e14-b39e-9b1f8e359553] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:39:35.544260 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7b41a56f-cd80-40b4-9480-81f8df3d630f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:35.544712 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7b41a56f-cd80-40b4-9480-81f8df3d630f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:35.545468 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7b41a56f-cd80-40b4-9480-81f8df3d630f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:35.545903 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7b41a56f-cd80-40b4-9480-81f8df3d630f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:35.676147 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7b41a56f-cd80-40b4-9480-81f8df3d630f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:39:35.684466 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-7b41a56f-cd80-40b4-9480-81f8df3d630f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553" status: 200 len: 1682 microversion: 2.1 time: 0.150810 May 28 17:39:35.685025 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 589/1175] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:39:35 2022] GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:39:36.702863 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-654d94da-a5fe-46fa-bb5d-07c7a040c2d8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:39:36.703588 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-654d94da-a5fe-46fa-bb5d-07c7a040c2d8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: d5769834-1cb8-4e14-b39e-9b1f8e359553] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:39:36.710763 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-654d94da-a5fe-46fa-bb5d-07c7a040c2d8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:36.711214 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-654d94da-a5fe-46fa-bb5d-07c7a040c2d8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:36.712007 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-654d94da-a5fe-46fa-bb5d-07c7a040c2d8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:36.712439 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-654d94da-a5fe-46fa-bb5d-07c7a040c2d8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:36.849971 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-654d94da-a5fe-46fa-bb5d-07c7a040c2d8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:39:36.857451 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-654d94da-a5fe-46fa-bb5d-07c7a040c2d8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553" status: 200 len: 1682 microversion: 2.1 time: 0.158759 May 28 17:39:36.858017 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 587/1176] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:39:36 2022] GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:39:37.875817 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1c0e03c7-fe75-407c-a706-87aedf942c77 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:39:37.876355 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1c0e03c7-fe75-407c-a706-87aedf942c77 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: d5769834-1cb8-4e14-b39e-9b1f8e359553] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:39:37.884592 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c0e03c7-fe75-407c-a706-87aedf942c77 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:37.885044 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c0e03c7-fe75-407c-a706-87aedf942c77 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:37.885815 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c0e03c7-fe75-407c-a706-87aedf942c77 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:37.886253 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1c0e03c7-fe75-407c-a706-87aedf942c77 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:38.018606 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1c0e03c7-fe75-407c-a706-87aedf942c77 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:39:38.026218 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1c0e03c7-fe75-407c-a706-87aedf942c77 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553" status: 200 len: 1682 microversion: 2.1 time: 0.156055 May 28 17:39:38.026791 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 590/1177] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:39:37 2022] GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:39:38.370921 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-f1f51827-5dba-4196-b2f5-eab921b9b703 req-8dc7bd95-b97b-424f-8c35-b94048e69d02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5769834-1cb8-4e14-b39e-9b1f8e359553", "name": "network-vif-deleted", "tag": "b7ee7236-7f4f-49a1-895b-3c97501aa1c1"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:39:38.383092 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-f1f51827-5dba-4196-b2f5-eab921b9b703 req-8dc7bd95-b97b-424f-8c35-b94048e69d02 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:38.383572 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-f1f51827-5dba-4196-b2f5-eab921b9b703 req-8dc7bd95-b97b-424f-8c35-b94048e69d02 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:38.394668 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-f1f51827-5dba-4196-b2f5-eab921b9b703 req-8dc7bd95-b97b-424f-8c35-b94048e69d02 service nova] Creating event network-vif-deleted:b7ee7236-7f4f-49a1-895b-3c97501aa1c1 for instance d5769834-1cb8-4e14-b39e-9b1f8e359553 on hv-cinder-84372 May 28 17:39:38.400017 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-f1f51827-5dba-4196-b2f5-eab921b9b703 req-8dc7bd95-b97b-424f-8c35-b94048e69d02 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034234 May 28 17:39:38.400620 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 588/1178] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:39:39.043488 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-af3a740e-76a5-461c-bf8c-e4d5803435d1 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:39:39.044255 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-af3a740e-76a5-461c-bf8c-e4d5803435d1 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: d5769834-1cb8-4e14-b39e-9b1f8e359553] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:39:39.050808 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-af3a740e-76a5-461c-bf8c-e4d5803435d1 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:39.051331 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-af3a740e-76a5-461c-bf8c-e4d5803435d1 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:39.052232 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-af3a740e-76a5-461c-bf8c-e4d5803435d1 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:39.052736 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-af3a740e-76a5-461c-bf8c-e4d5803435d1 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:39.087678 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-af3a740e-76a5-461c-bf8c-e4d5803435d1 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:39.088126 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-af3a740e-76a5-461c-bf8c-e4d5803435d1 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:39.088620 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-af3a740e-76a5-461c-bf8c-e4d5803435d1 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lazy-loading 'fault' on Instance uuid d5769834-1cb8-4e14-b39e-9b1f8e359553 {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 17:39:39.132346 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-af3a740e-76a5-461c-bf8c-e4d5803435d1 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:39:39.140136 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-af3a740e-76a5-461c-bf8c-e4d5803435d1 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553" status: 200 len: 1332 microversion: 2.1 time: 0.100483 May 28 17:39:39.140709 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 591/1179] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:39:39 2022] GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553 => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:39:40.158152 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a2cba1dc-f228-48a9-a29a-911309aa59bb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:39:40.158772 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-a2cba1dc-f228-48a9-a29a-911309aa59bb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: d5769834-1cb8-4e14-b39e-9b1f8e359553] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:39:40.165601 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a2cba1dc-f228-48a9-a29a-911309aa59bb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:40.166051 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a2cba1dc-f228-48a9-a29a-911309aa59bb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:40.166809 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a2cba1dc-f228-48a9-a29a-911309aa59bb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:40.167245 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-a2cba1dc-f228-48a9-a29a-911309aa59bb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:40.180143 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-a2cba1dc-f228-48a9-a29a-911309aa59bb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] HTTP exception thrown: Instance d5769834-1cb8-4e14-b39e-9b1f8e359553 could not be found. May 28 17:39:40.181727 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a2cba1dc-f228-48a9-a29a-911309aa59bb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Request method failure captured: May 28 17:39:40.181727 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553 HTTP/1.1 May 28 17:39:40.181727 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept: application/json May 28 17:39:40.181727 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity May 28 17:39:40.181727 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Connection: close May 28 17:39:40.181727 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Length: 0 May 28 17:39:40.181727 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Type: application/json May 28 17:39:40.181727 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 May 28 17:39:40.181727 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None May 28 17:39:40.181727 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 May 28 17:39:40.181727 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABiklztpzsrcs87QXRJpScgk-5tUukjwPy1pG5nwYCeqw-1TdfbNHEPQv0dxfORMmAI_huWNfz4S1kkPQDKvHAPGaV0itPNNhduphbnIQQ9CdIotGmgnrod8uAS5LCp8f9bs3_RlkUgWcVbaRmZwj6AERxTjQmBOF2VAsv1p_k3m3IU8vI May 28 17:39:40.181727 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Id: None May 28 17:39:40.181727 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Name: None May 28 17:39:40.181727 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed May 28 17:39:40.181727 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True May 28 17:39:40.181727 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default May 28 17:39:40.181727 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default May 28 17:39:40.181727 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Id: 9525b35792a04dc3a6f109cb39ee9d50 May 28 17:39:40.181727 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:39:40.181727 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Role: reader,member May 28 17:39:40.181727 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Roles: reader,member May 28 17:39:40.183320 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9525b35792a04dc3a6f109cb39ee9d50", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:39:40.183320 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:39:40.183320 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 9525b35792a04dc3a6f109cb39ee9d50 May 28 17:39:40.183320 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:39:40.183320 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeNegativeTest-1796155594-project May 28 17:39:40.183320 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default May 28 17:39:40.183320 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default May 28 17:39:40.183320 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Id: 7343386004e24474bc0af9126f47182b May 28 17:39:40.183320 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeNegativeTest-1796155594-project May 28 17:39:40.183320 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: method: > May 28 17:39:40.183320 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: exception: Instance d5769834-1cb8-4e14-b39e-9b1f8e359553 could not be found. May 28 17:39:40.183320 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: action_args: {'id': 'd5769834-1cb8-4e14-b39e-9b1f8e359553'} May 28 17:39:40.184477 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:39:40.184477 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:39:40.184477 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:39:40.184477 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:39:40.184477 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:39:40.184477 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:39:40.184477 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:39:40.184477 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:39:40.184477 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:39:40.184477 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:39:40.184477 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5769834-1cb8-4e14-b39e-9b1f8e359553 could not be found. May 28 17:39:40.184477 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:39:40.184477 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:39:40.184477 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:39:40.184477 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:39:40.184477 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:39:40.184477 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:39:40.184477 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:39:40.184477 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:39:40.184477 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:39:40.186102 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:39:40.186102 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:39:40.186102 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:39:40.186102 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:39:40.186102 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:39:40.186102 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:39:40.186102 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:39:40.186102 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5769834-1cb8-4e14-b39e-9b1f8e359553 could not be found. May 28 17:39:40.186102 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:39:40.186102 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:39:40.186102 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:39:40.186102 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:39:40.186102 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:39:40.186102 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:39:40.186102 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:39:40.186102 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:39:40.186102 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5769834-1cb8-4e14-b39e-9b1f8e359553 could not be found. May 28 17:39:40.186102 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:39:40.187662 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-a2cba1dc-f228-48a9-a29a-911309aa59bb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Returning 404 to user: Instance d5769834-1cb8-4e14-b39e-9b1f8e359553 could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:39:40.187662 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-a2cba1dc-f228-48a9-a29a-911309aa59bb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553" status: 404 len: 111 microversion: 2.1 time: 0.029724 May 28 17:39:40.187662 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 589/1180] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:39:40 2022] GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:39:40.191764 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-9f05d86e-0edd-4073-89a7-cedbd796b1e5 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '.version_select at 0x7f9efcc79280>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:39:40.208696 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-9f05d86e-0edd-4073-89a7-cedbd796b1e5 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1048827598" status: 202 len: 0 microversion: 2.1 time: 0.020225 May 28 17:39:40.209226 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 592/1181] 10.222.0.33 () {58 vars in 1220 bytes} [Sat May 28 17:39:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1048827598 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 17:39:40.808630 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8b362789-b773-4518-9362-05f07a9ac07e tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Action: 'create', calling method: .version_select at 0x7f9efc2f2700>, body: {"keypair": {"name": "tempest-keypair-57586635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSe3RBaVE3OrWcRkK11k6lNK+GEqeEoizC1u1zdbCeOrMUVv8nBBqnBxMhyKmAnrOLTLVqCkCCoYJQZ30YMFWEGcxymOunUpCiKLkt2zmlHFz0/Y6jkJ/qtHymboBF5iA=="}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:39:40.822841 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-8b362789-b773-4518-9362-05f07a9ac07e tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Getting quotas for project 9525b35792a04dc3a6f109cb39ee9d50. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:39:40.826597 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-8b362789-b773-4518-9362-05f07a9ac07e tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Getting quotas for user 7343386004e24474bc0af9126f47182b and project 9525b35792a04dc3a6f109cb39ee9d50. Resources: {'key_pairs'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:39:40.848848 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8b362789-b773-4518-9362-05f07a9ac07e tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.044048 May 28 17:39:40.849539 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 590/1182] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 17:39:40 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:39:42.080883 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-540be984-6f92-492f-8a97-86a1811be462 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-102741763", "imageRef": "b2aab55c-a793-472a-bc32-81af689ad609", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f73c6d30-f59b-4e03-9c62-138278150c67"}], "security_groups": [{"name": "tempest-securitygroup--271281330"}], "key_name": "tempest-keypair-57586635", "user_data": "}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:39:42.181891 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.network.neutron [None req-540be984-6f92-492f-8a97-86a1811be462 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] validate_networks() for [('f73c6d30-f59b-4e03-9c62-138278150c67', None, None, None, None, None)] {{(pid=117604) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 17:39:42.647978 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-540be984-6f92-492f-8a97-86a1811be462 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Flavor limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 17:39:42.648397 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-540be984-6f92-492f-8a97-86a1811be462 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Image limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 17:39:42.648901 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-540be984-6f92-492f-8a97-86a1811be462 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Flavor pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 17:39:42.649305 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-540be984-6f92-492f-8a97-86a1811be462 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Image pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 17:39:42.649711 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-540be984-6f92-492f-8a97-86a1811be462 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 17:39:42.658397 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-540be984-6f92-492f-8a97-86a1811be462 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:42.658856 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-540be984-6f92-492f-8a97-86a1811be462 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:42.659648 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-540be984-6f92-492f-8a97-86a1811be462 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:42.660078 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-540be984-6f92-492f-8a97-86a1811be462 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:42.677017 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-540be984-6f92-492f-8a97-86a1811be462 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Getting quotas for project 9525b35792a04dc3a6f109cb39ee9d50. Resources: {'instances', 'cores', 'ram'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:39:42.680926 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-540be984-6f92-492f-8a97-86a1811be462 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Getting quotas for user 7343386004e24474bc0af9126f47182b and project 9525b35792a04dc3a6f109cb39ee9d50. Resources: {'instances', 'cores', 'ram'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:39:42.691653 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-540be984-6f92-492f-8a97-86a1811be462 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Going to run 1 instances... {{(pid=117604) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 17:39:42.693810 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-540be984-6f92-492f-8a97-86a1811be462 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b2aab55c-a793-472a-bc32-81af689ad609',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 17:39:42.741001 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-540be984-6f92-492f-8a97-86a1811be462 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.664809 May 28 17:39:42.741937 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 593/1183] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 17:39:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 17:39:42.752536 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-57998cc1-dd00-4a02-abba-a8b5e25025d7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:39:42.753155 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-57998cc1-dd00-4a02-abba-a8b5e25025d7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:39:42.815102 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-57998cc1-dd00-4a02-abba-a8b5e25025d7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:39:42.822338 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-57998cc1-dd00-4a02-abba-a8b5e25025d7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9" status: 200 len: 1239 microversion: 2.1 time: 0.074532 May 28 17:39:42.822900 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 591/1184] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:39:42 2022] GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 => generated 1239 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:39:43.839939 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-fa446e3d-a15d-4f33-b5ec-ae354c714baa tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:39:43.840561 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-fa446e3d-a15d-4f33-b5ec-ae354c714baa tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:39:43.847110 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fa446e3d-a15d-4f33-b5ec-ae354c714baa tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:43.847598 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fa446e3d-a15d-4f33-b5ec-ae354c714baa tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:43.849016 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fa446e3d-a15d-4f33-b5ec-ae354c714baa tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:43.849582 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fa446e3d-a15d-4f33-b5ec-ae354c714baa tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:43.913729 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-fa446e3d-a15d-4f33-b5ec-ae354c714baa tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:39:43.921446 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-fa446e3d-a15d-4f33-b5ec-ae354c714baa tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9" status: 200 len: 1297 microversion: 2.1 time: 0.085926 May 28 17:39:43.922013 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 594/1185] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:39:43 2022] GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:39:44.937992 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7a46da4b-375e-4653-adad-61eacea6b91e tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:39:44.938669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7a46da4b-375e-4653-adad-61eacea6b91e tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:39:44.946055 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7a46da4b-375e-4653-adad-61eacea6b91e tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:44.946505 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7a46da4b-375e-4653-adad-61eacea6b91e tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:44.947506 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7a46da4b-375e-4653-adad-61eacea6b91e tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:44.947950 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7a46da4b-375e-4653-adad-61eacea6b91e tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:45.162602 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-7a46da4b-375e-4653-adad-61eacea6b91e tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:39:45.171211 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7a46da4b-375e-4653-adad-61eacea6b91e tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9" status: 200 len: 1364 microversion: 2.1 time: 0.237053 May 28 17:39:45.172624 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 592/1186] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:39:44 2022] GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 => generated 1364 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:39:45.612403 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-d0bf6966-e656-4179-a92a-d267ef4dfd24 req-1cff4fc5-f83c-48fb-971f-f369f885bd0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9", "tag": "1799c11d-08f1-442a-b6df-9645693baeb0"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:39:45.621823 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-d0bf6966-e656-4179-a92a-d267ef4dfd24 req-1cff4fc5-f83c-48fb-971f-f369f885bd0d service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:45.622322 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-d0bf6966-e656-4179-a92a-d267ef4dfd24 req-1cff4fc5-f83c-48fb-971f-f369f885bd0d service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:45.635377 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-d0bf6966-e656-4179-a92a-d267ef4dfd24 req-1cff4fc5-f83c-48fb-971f-f369f885bd0d service nova] Creating event network-changed:1799c11d-08f1-442a-b6df-9645693baeb0 for instance c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 on hv-cinder-84372 May 28 17:39:45.640736 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-d0bf6966-e656-4179-a92a-d267ef4dfd24 req-1cff4fc5-f83c-48fb-971f-f369f885bd0d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032223 May 28 17:39:45.641340 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 595/1187] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:39:46.188646 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-89dd5cf9-ce75-4daa-ab9f-929bd5a13385 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:39:46.189267 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-89dd5cf9-ce75-4daa-ab9f-929bd5a13385 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:39:46.196410 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-89dd5cf9-ce75-4daa-ab9f-929bd5a13385 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:46.196859 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-89dd5cf9-ce75-4daa-ab9f-929bd5a13385 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:46.197620 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-89dd5cf9-ce75-4daa-ab9f-929bd5a13385 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:46.198055 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-89dd5cf9-ce75-4daa-ab9f-929bd5a13385 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:46.325329 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-89dd5cf9-ce75-4daa-ab9f-929bd5a13385 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:39:46.332678 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-89dd5cf9-ce75-4daa-ab9f-929bd5a13385 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9" status: 200 len: 1364 microversion: 2.1 time: 0.147886 May 28 17:39:46.333367 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 593/1188] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:39:46 2022] GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:39:47.350520 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a416ef21-71e7-402a-af0b-6af9c822facb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:39:47.351210 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a416ef21-71e7-402a-af0b-6af9c822facb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:39:47.357451 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a416ef21-71e7-402a-af0b-6af9c822facb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:47.357894 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a416ef21-71e7-402a-af0b-6af9c822facb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:47.358643 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a416ef21-71e7-402a-af0b-6af9c822facb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:47.359076 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a416ef21-71e7-402a-af0b-6af9c822facb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:47.488921 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a416ef21-71e7-402a-af0b-6af9c822facb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:39:47.496305 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a416ef21-71e7-402a-af0b-6af9c822facb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9" status: 200 len: 1364 microversion: 2.1 time: 0.150462 May 28 17:39:47.496864 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 596/1189] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:39:47 2022] GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:39:48.513537 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-307c9552-33a0-4b8e-a8ef-c77c90acc795 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:39:48.514229 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-307c9552-33a0-4b8e-a8ef-c77c90acc795 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:39:48.520409 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-307c9552-33a0-4b8e-a8ef-c77c90acc795 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:48.521355 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-307c9552-33a0-4b8e-a8ef-c77c90acc795 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:48.522114 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-307c9552-33a0-4b8e-a8ef-c77c90acc795 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:48.522551 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-307c9552-33a0-4b8e-a8ef-c77c90acc795 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:48.652753 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-307c9552-33a0-4b8e-a8ef-c77c90acc795 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:39:48.660110 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-307c9552-33a0-4b8e-a8ef-c77c90acc795 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9" status: 200 len: 1364 microversion: 2.1 time: 0.150458 May 28 17:39:48.660678 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 594/1190] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:39:48 2022] GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:39:49.677906 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1e161ee6-43a1-4dcb-8fd0-820710bfb1f2 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:39:49.678496 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1e161ee6-43a1-4dcb-8fd0-820710bfb1f2 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:39:49.685121 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1e161ee6-43a1-4dcb-8fd0-820710bfb1f2 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:49.685587 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1e161ee6-43a1-4dcb-8fd0-820710bfb1f2 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:49.686339 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1e161ee6-43a1-4dcb-8fd0-820710bfb1f2 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:49.686772 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1e161ee6-43a1-4dcb-8fd0-820710bfb1f2 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:49.821400 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-1e161ee6-43a1-4dcb-8fd0-820710bfb1f2 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:39:49.828731 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1e161ee6-43a1-4dcb-8fd0-820710bfb1f2 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9" status: 200 len: 1364 microversion: 2.1 time: 0.154823 May 28 17:39:49.829415 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 597/1191] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:39:49 2022] GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:39:50.846000 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e79ab185-d39e-4380-803b-f18732468eed tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:39:50.846536 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-e79ab185-d39e-4380-803b-f18732468eed tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:39:50.853983 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e79ab185-d39e-4380-803b-f18732468eed tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:50.854436 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e79ab185-d39e-4380-803b-f18732468eed tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:50.855200 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e79ab185-d39e-4380-803b-f18732468eed tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:50.855662 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e79ab185-d39e-4380-803b-f18732468eed tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:50.989333 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-e79ab185-d39e-4380-803b-f18732468eed tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:39:50.996696 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-e79ab185-d39e-4380-803b-f18732468eed tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9" status: 200 len: 1364 microversion: 2.1 time: 0.154615 May 28 17:39:50.997261 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 595/1192] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:39:50 2022] GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:39:52.014358 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-006149f4-75ad-46c0-8425-d34b358f73d8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:39:52.014895 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-006149f4-75ad-46c0-8425-d34b358f73d8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:39:52.022015 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-006149f4-75ad-46c0-8425-d34b358f73d8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:52.022456 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-006149f4-75ad-46c0-8425-d34b358f73d8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:52.023206 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-006149f4-75ad-46c0-8425-d34b358f73d8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:52.023661 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-006149f4-75ad-46c0-8425-d34b358f73d8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:52.170054 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-006149f4-75ad-46c0-8425-d34b358f73d8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:39:52.177896 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-006149f4-75ad-46c0-8425-d34b358f73d8 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9" status: 200 len: 1364 microversion: 2.1 time: 0.166990 May 28 17:39:52.178450 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 598/1193] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:39:52 2022] GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:39:52.417320 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-0614dff3-1bba-4a63-8252-a89ab4746611 req-c3989f1b-69fd-4e95-890b-a8929160aede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9", "name": "network-vif-plugged", "status": "completed", "tag": "1799c11d-08f1-442a-b6df-9645693baeb0"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:39:52.426022 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-0614dff3-1bba-4a63-8252-a89ab4746611 req-c3989f1b-69fd-4e95-890b-a8929160aede service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:52.426469 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-0614dff3-1bba-4a63-8252-a89ab4746611 req-c3989f1b-69fd-4e95-890b-a8929160aede service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:52.442077 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-0614dff3-1bba-4a63-8252-a89ab4746611 req-c3989f1b-69fd-4e95-890b-a8929160aede service nova] Creating event network-vif-plugged:1799c11d-08f1-442a-b6df-9645693baeb0 for instance c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 on hv-cinder-84372 May 28 17:39:52.449215 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-0614dff3-1bba-4a63-8252-a89ab4746611 req-c3989f1b-69fd-4e95-890b-a8929160aede service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035345 May 28 17:39:52.450120 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 596/1194] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:39:53.195000 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2cdeb665-45f4-49b7-b663-85dc61262fd9 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:39:53.195652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2cdeb665-45f4-49b7-b663-85dc61262fd9 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:39:53.197599 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:39:53.198384 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=6 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:39:53.204729 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2cdeb665-45f4-49b7-b663-85dc61262fd9 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:53.205171 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2cdeb665-45f4-49b7-b663-85dc61262fd9 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:53.205923 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2cdeb665-45f4-49b7-b663-85dc61262fd9 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:53.206353 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2cdeb665-45f4-49b7-b663-85dc61262fd9 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:53.337024 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-2cdeb665-45f4-49b7-b663-85dc61262fd9 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:39:53.344393 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2cdeb665-45f4-49b7-b663-85dc61262fd9 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9" status: 200 len: 1364 microversion: 2.1 time: 0.153774 May 28 17:39:53.344952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 599/1195] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:39:53 2022] GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:39:54.358565 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=6 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:39:54.363084 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c181e5fd-f898-46c3-810c-f733b146c12d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:39:54.363809 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c181e5fd-f898-46c3-810c-f733b146c12d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:39:54.370898 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c181e5fd-f898-46c3-810c-f733b146c12d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:54.371360 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c181e5fd-f898-46c3-810c-f733b146c12d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:54.372136 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c181e5fd-f898-46c3-810c-f733b146c12d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:54.372574 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c181e5fd-f898-46c3-810c-f733b146c12d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:54.513654 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-c181e5fd-f898-46c3-810c-f733b146c12d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:39:54.521032 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c181e5fd-f898-46c3-810c-f733b146c12d tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9" status: 200 len: 1364 microversion: 2.1 time: 0.163447 May 28 17:39:54.521590 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 597/1196] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:39:54 2022] GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:39:55.537794 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d721dd30-e9a0-4c70-959c-c01eccc34a9c tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:39:55.538412 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d721dd30-e9a0-4c70-959c-c01eccc34a9c tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:39:55.544951 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d721dd30-e9a0-4c70-959c-c01eccc34a9c tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:55.545407 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d721dd30-e9a0-4c70-959c-c01eccc34a9c tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:55.546177 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d721dd30-e9a0-4c70-959c-c01eccc34a9c tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:55.546617 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d721dd30-e9a0-4c70-959c-c01eccc34a9c tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:55.675124 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d721dd30-e9a0-4c70-959c-c01eccc34a9c tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:39:55.682558 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d721dd30-e9a0-4c70-959c-c01eccc34a9c tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9" status: 200 len: 1554 microversion: 2.1 time: 0.148726 May 28 17:39:55.683123 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 600/1197] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:39:55 2022] GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:39:55.699266 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c4154f72-9b57-461f-8d55-340841ce8ce7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:39:55.699864 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c4154f72-9b57-461f-8d55-340841ce8ce7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:39:55.702213 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:39:55.707700 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c4154f72-9b57-461f-8d55-340841ce8ce7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:55.708152 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c4154f72-9b57-461f-8d55-340841ce8ce7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:55.709742 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c4154f72-9b57-461f-8d55-340841ce8ce7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:55.710483 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c4154f72-9b57-461f-8d55-340841ce8ce7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:55.714937 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:39:55.792226 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c4154f72-9b57-461f-8d55-340841ce8ce7 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096915 May 28 17:39:55.792822 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 598/1198] 10.222.0.33 () {58 vars in 1274 bytes} [Sat May 28 17:39:55 2022] GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:39:56.687793 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-e464d4f3-0903-4b03-99c0-537b992e16f8 req-cd1a6979-edb4-4bd8-b8e4-fa3e567bca61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9", "tag": "1799c11d-08f1-442a-b6df-9645693baeb0"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:39:56.691624 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:39:56.698074 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-e464d4f3-0903-4b03-99c0-537b992e16f8 req-cd1a6979-edb4-4bd8-b8e4-fa3e567bca61 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:39:56.698580 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-e464d4f3-0903-4b03-99c0-537b992e16f8 req-cd1a6979-edb4-4bd8-b8e4-fa3e567bca61 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:39:56.702931 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:39:56.712707 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-e464d4f3-0903-4b03-99c0-537b992e16f8 req-cd1a6979-edb4-4bd8-b8e4-fa3e567bca61 service nova] Creating event network-changed:1799c11d-08f1-442a-b6df-9645693baeb0 for instance c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 on hv-cinder-84372 May 28 17:39:56.718133 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-e464d4f3-0903-4b03-99c0-537b992e16f8 req-cd1a6979-edb4-4bd8-b8e4-fa3e567bca61 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033843 May 28 17:39:56.718969 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 601/1199] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:40:20.934080 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:40:20.934808 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=3 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:40:20.939073 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-267d45f9-824e-44c4-9aa0-4d2f9dbcaccb tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:40:20.939609 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-267d45f9-824e-44c4-9aa0-4d2f9dbcaccb tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:40:20.947259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-267d45f9-824e-44c4-9aa0-4d2f9dbcaccb tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:20.947794 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-267d45f9-824e-44c4-9aa0-4d2f9dbcaccb tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:20.948570 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-267d45f9-824e-44c4-9aa0-4d2f9dbcaccb tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:20.949006 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-267d45f9-824e-44c4-9aa0-4d2f9dbcaccb tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:20.972805 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-267d45f9-824e-44c4-9aa0-4d2f9dbcaccb tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Going to try to terminate instance {{(pid=117605) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 17:40:21.047391 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-267d45f9-824e-44c4-9aa0-4d2f9dbcaccb tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "DELETE /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 204 len: 0 microversion: 2.1 time: 0.114270 May 28 17:40:21.048066 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 599/1200] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 17:40:20 2022] DELETE /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 17:40:21.058604 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d956b148-ebac-4e1a-930e-bb780aadf425 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:40:21.059308 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d956b148-ebac-4e1a-930e-bb780aadf425 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:40:21.066506 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d956b148-ebac-4e1a-930e-bb780aadf425 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:21.066955 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d956b148-ebac-4e1a-930e-bb780aadf425 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:21.067748 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d956b148-ebac-4e1a-930e-bb780aadf425 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:21.068190 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d956b148-ebac-4e1a-930e-bb780aadf425 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:21.200857 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d956b148-ebac-4e1a-930e-bb780aadf425 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:40:21.208191 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d956b148-ebac-4e1a-930e-bb780aadf425 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 200 len: 1580 microversion: 2.1 time: 0.155663 May 28 17:40:21.208743 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 602/1201] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:40:21 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 1580 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:40:22.226366 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9c3af489-a342-4230-8203-829c6ede09d6 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:40:22.227081 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9c3af489-a342-4230-8203-829c6ede09d6 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:40:22.234129 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9c3af489-a342-4230-8203-829c6ede09d6 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:22.234572 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9c3af489-a342-4230-8203-829c6ede09d6 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:22.235323 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9c3af489-a342-4230-8203-829c6ede09d6 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:22.235775 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9c3af489-a342-4230-8203-829c6ede09d6 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:22.370174 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-9c3af489-a342-4230-8203-829c6ede09d6 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:40:22.377797 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9c3af489-a342-4230-8203-829c6ede09d6 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 200 len: 1580 microversion: 2.1 time: 0.155639 May 28 17:40:22.378353 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 600/1202] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:40:22 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 1580 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:40:23.395041 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-04a4cafa-3a01-45a5-8b5f-6eb7a66efb12 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:40:23.397102 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-04a4cafa-3a01-45a5-8b5f-6eb7a66efb12 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:40:23.406289 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-04a4cafa-3a01-45a5-8b5f-6eb7a66efb12 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:23.406897 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-04a4cafa-3a01-45a5-8b5f-6eb7a66efb12 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:23.407703 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-04a4cafa-3a01-45a5-8b5f-6eb7a66efb12 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:23.408136 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-04a4cafa-3a01-45a5-8b5f-6eb7a66efb12 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:23.473339 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-04a4cafa-3a01-45a5-8b5f-6eb7a66efb12 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:40:23.481649 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-04a4cafa-3a01-45a5-8b5f-6eb7a66efb12 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 200 len: 1512 microversion: 2.1 time: 0.090497 May 28 17:40:23.482345 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 603/1203] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:40:23 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 1512 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:40:23.676128 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-babff644-ec2a-48b0-bfd8-20789df6e10f req-65999675-2f2e-4549-a3ba-6b7076175bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b782e2-0501-4467-9b07-0a0766795ad4", "name": "network-vif-deleted", "tag": "e8ae62d4-a8b6-4a83-8ce0-f58a2953d5ca"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:40:23.686957 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-babff644-ec2a-48b0-bfd8-20789df6e10f req-65999675-2f2e-4549-a3ba-6b7076175bf6 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:23.687429 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-babff644-ec2a-48b0-bfd8-20789df6e10f req-65999675-2f2e-4549-a3ba-6b7076175bf6 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:23.699793 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-babff644-ec2a-48b0-bfd8-20789df6e10f req-65999675-2f2e-4549-a3ba-6b7076175bf6 service nova] Creating event network-vif-deleted:e8ae62d4-a8b6-4a83-8ce0-f58a2953d5ca for instance 03b782e2-0501-4467-9b07-0a0766795ad4 on hv-cinder-84372 May 28 17:40:23.705341 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-babff644-ec2a-48b0-bfd8-20789df6e10f req-65999675-2f2e-4549-a3ba-6b7076175bf6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032911 May 28 17:40:23.705973 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 601/1204] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:40:24.498379 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a876d183-057e-401a-9ec9-66c917fcae31 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:40:24.499372 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a876d183-057e-401a-9ec9-66c917fcae31 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:40:24.506767 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a876d183-057e-401a-9ec9-66c917fcae31 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:24.507173 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a876d183-057e-401a-9ec9-66c917fcae31 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:24.508034 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a876d183-057e-401a-9ec9-66c917fcae31 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:24.508964 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a876d183-057e-401a-9ec9-66c917fcae31 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:24.523204 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-a876d183-057e-401a-9ec9-66c917fcae31 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] HTTP exception thrown: Instance 03b782e2-0501-4467-9b07-0a0766795ad4 could not be found. May 28 17:40:24.525583 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a876d183-057e-401a-9ec9-66c917fcae31 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Request method failure captured: May 28 17:40:24.525583 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 HTTP/1.1 May 28 17:40:24.525583 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:40:24.525583 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:40:24.525583 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:40:24.525583 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 0 May 28 17:40:24.525583 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:40:24.525583 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:40:24.525583 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:40:24.525583 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:40:24.525583 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABikl2sVHxHq3Z4FGL7IPua6hCg_iOssqnObQf3QnEjNK0lGhbyZ8NkV55Krc4LDl7izrmdukgf7T8-EN3nhz-JVqxugBxZcp1WHvcPMoqVhkZLOGsjsAqx9z2ozPFsVJR-1-Dl7ci5MVG7-OchToZXa8Ie-Z18Y6dRprxI9GMrLNTiZO4 May 28 17:40:24.525583 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:40:24.525583 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:40:24.525583 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:40:24.525583 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:40:24.525583 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:40:24.525583 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:40:24.525583 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: 3785f78e6d1048cfa0b5b123fdd909c8 May 28 17:40:24.525583 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-TestVolumeBootPattern-1713257441 May 28 17:40:24.525583 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:40:24.525583 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:40:24.527010 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3785f78e6d1048cfa0b5b123fdd909c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3785f78e6d1048cfa0b5b123fdd909c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3785f78e6d1048cfa0b5b123fdd909c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3785f78e6d1048cfa0b5b123fdd909c8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:40:24.527010 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-TestVolumeBootPattern-1713257441 May 28 17:40:24.527010 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 3785f78e6d1048cfa0b5b123fdd909c8 May 28 17:40:24.527010 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-TestVolumeBootPattern-1713257441 May 28 17:40:24.527010 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-TestVolumeBootPattern-1713257441-project May 28 17:40:24.527010 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:40:24.527010 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:40:24.527010 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: 4a827bedc4b84508bb7770a09efee3f5 May 28 17:40:24.527010 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-TestVolumeBootPattern-1713257441-project May 28 17:40:24.527010 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: > May 28 17:40:24.527010 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Instance 03b782e2-0501-4467-9b07-0a0766795ad4 could not be found. May 28 17:40:24.527010 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'id': '03b782e2-0501-4467-9b07-0a0766795ad4'} May 28 17:40:24.527922 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:40:24.527922 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:40:24.527922 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:40:24.527922 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:40:24.527922 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:40:24.527922 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:40:24.527922 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:40:24.527922 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:40:24.527922 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:40:24.527922 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:40:24.527922 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03b782e2-0501-4467-9b07-0a0766795ad4 could not be found. May 28 17:40:24.527922 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:40:24.527922 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:40:24.527922 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:40:24.527922 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:40:24.527922 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:40:24.527922 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:40:24.527922 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:40:24.527922 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:40:24.527922 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:40:24.529721 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:40:24.529721 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:40:24.529721 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:40:24.529721 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:40:24.529721 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:40:24.529721 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:40:24.529721 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:40:24.529721 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03b782e2-0501-4467-9b07-0a0766795ad4 could not be found. May 28 17:40:24.529721 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:40:24.529721 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:40:24.529721 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:40:24.529721 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:40:24.529721 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:40:24.529721 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:40:24.529721 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:40:24.529721 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:40:24.529721 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03b782e2-0501-4467-9b07-0a0766795ad4 could not be found. May 28 17:40:24.529721 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:40:24.531671 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a876d183-057e-401a-9ec9-66c917fcae31 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Returning 404 to user: Instance 03b782e2-0501-4467-9b07-0a0766795ad4 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:40:24.531671 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a876d183-057e-401a-9ec9-66c917fcae31 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 404 len: 111 microversion: 2.1 time: 0.032610 May 28 17:40:24.535320 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 604/1205] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:40:24 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:40:24.623864 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2c54538e-6975-40d7-a278-ccb9c357dbbc tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1299002024", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1169689163", "security_groups": [{"name": "tempest-secgroup-smoke-1697074357"}], "block_device_mapping_v2": [{"uuid": "ae2cbe57-b91a-4a57-9442-4d8dbf6464a6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a98bf986-b097-428c-84c6-2a59a4df1a9f"}]}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:40:24.742526 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.network.neutron [None req-2c54538e-6975-40d7-a278-ccb9c357dbbc tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] validate_networks() for [('a98bf986-b097-428c-84c6-2a59a4df1a9f', None, None, None, None, None)] {{(pid=117605) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 17:40:25.106308 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-2c54538e-6975-40d7-a278-ccb9c357dbbc tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Flavor limits 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 17:40:25.106711 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-2c54538e-6975-40d7-a278-ccb9c357dbbc tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Image limits 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 17:40:25.107247 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-2c54538e-6975-40d7-a278-ccb9c357dbbc tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Flavor pref 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 17:40:25.107738 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-2c54538e-6975-40d7-a278-ccb9c357dbbc tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Image pref 0:0:0 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 17:40:25.108158 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.virt.hardware [None req-2c54538e-6975-40d7-a278-ccb9c357dbbc tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117605) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 17:40:25.116954 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2c54538e-6975-40d7-a278-ccb9c357dbbc tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:25.117406 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2c54538e-6975-40d7-a278-ccb9c357dbbc tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:25.118323 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2c54538e-6975-40d7-a278-ccb9c357dbbc tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:25.118763 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2c54538e-6975-40d7-a278-ccb9c357dbbc tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:25.135955 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-2c54538e-6975-40d7-a278-ccb9c357dbbc tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Getting quotas for project 3785f78e6d1048cfa0b5b123fdd909c8. Resources: {'instances', 'cores', 'ram'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:40:25.139944 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.quota [None req-2c54538e-6975-40d7-a278-ccb9c357dbbc tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Getting quotas for user 4a827bedc4b84508bb7770a09efee3f5 and project 3785f78e6d1048cfa0b5b123fdd909c8. Resources: {'instances', 'cores', 'ram'} {{(pid=117605) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:40:25.205605 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2c54538e-6975-40d7-a278-ccb9c357dbbc tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Going to run 1 instances... {{(pid=117605) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 17:40:25.207934 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2c54538e-6975-40d7-a278-ccb9c357dbbc tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 55b6f098-3687-4ce1-a74a-2e050591eddd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ae2cbe57-b91a-4a57-9442-4d8dbf6464a6',volume_size=None,volume_type=None)] {{(pid=117605) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 17:40:25.332226 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2c54538e-6975-40d7-a278-ccb9c357dbbc tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [4e1dcad4-8448-4419-8bfe-4e6c8af41056] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 17:40:26.340911 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO oslo.messaging._drivers.impl_rabbit [None req-2c54538e-6975-40d7-a278-ccb9c357dbbc tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [4e1dcad4-8448-4419-8bfe-4e6c8af41056] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 51622. May 28 17:40:26.344752 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2c54538e-6975-40d7-a278-ccb9c357dbbc tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.725175 May 28 17:40:26.345438 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 602/1206] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 17:40:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 17:40:26.355705 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-acdc2e14-705a-4999-9500-b2a845e57933 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:40:26.356318 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-acdc2e14-705a-4999-9500-b2a845e57933 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 55b6f098-3687-4ce1-a74a-2e050591eddd] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:40:26.414284 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-acdc2e14-705a-4999-9500-b2a845e57933 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:40:26.422156 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-acdc2e14-705a-4999-9500-b2a845e57933 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd" status: 200 len: 1095 microversion: 2.1 time: 0.070439 May 28 17:40:26.422957 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 605/1207] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:40:26 2022] GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:40:27.441590 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-afd149bc-d015-4082-9620-f118396ef39b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:40:27.442215 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-afd149bc-d015-4082-9620-f118396ef39b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 55b6f098-3687-4ce1-a74a-2e050591eddd] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:40:27.448750 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-afd149bc-d015-4082-9620-f118396ef39b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:27.449199 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-afd149bc-d015-4082-9620-f118396ef39b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:27.449969 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-afd149bc-d015-4082-9620-f118396ef39b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:27.450412 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-afd149bc-d015-4082-9620-f118396ef39b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:27.550053 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-afd149bc-d015-4082-9620-f118396ef39b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:40:27.558188 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-afd149bc-d015-4082-9620-f118396ef39b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd" status: 200 len: 1211 microversion: 2.1 time: 0.121007 May 28 17:40:27.558762 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 603/1208] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:40:27 2022] GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd => generated 1211 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:40:28.575006 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-119a9bc1-810a-41ce-a72c-c1c5ae34c914 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:40:28.576501 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-119a9bc1-810a-41ce-a72c-c1c5ae34c914 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 55b6f098-3687-4ce1-a74a-2e050591eddd] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:40:28.583734 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-119a9bc1-810a-41ce-a72c-c1c5ae34c914 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:28.584187 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-119a9bc1-810a-41ce-a72c-c1c5ae34c914 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:28.584943 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-119a9bc1-810a-41ce-a72c-c1c5ae34c914 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:28.585369 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-119a9bc1-810a-41ce-a72c-c1c5ae34c914 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:28.742020 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-a5a9cad4-f826-442c-bc0e-b29b28a8b042 req-f38d3baf-d046-42c0-a7ec-9a3c4eeeaf95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55b6f098-3687-4ce1-a74a-2e050591eddd", "tag": "5c34b26f-cf27-4dcb-bde9-01d75bac0901"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:40:28.758882 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-a5a9cad4-f826-442c-bc0e-b29b28a8b042 req-f38d3baf-d046-42c0-a7ec-9a3c4eeeaf95 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:28.759928 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-a5a9cad4-f826-442c-bc0e-b29b28a8b042 req-f38d3baf-d046-42c0-a7ec-9a3c4eeeaf95 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:28.773020 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-a5a9cad4-f826-442c-bc0e-b29b28a8b042 req-f38d3baf-d046-42c0-a7ec-9a3c4eeeaf95 service nova] Creating event network-changed:5c34b26f-cf27-4dcb-bde9-01d75bac0901 for instance 55b6f098-3687-4ce1-a74a-2e050591eddd on hv-cinder-84372 May 28 17:40:28.778997 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-a5a9cad4-f826-442c-bc0e-b29b28a8b042 req-f38d3baf-d046-42c0-a7ec-9a3c4eeeaf95 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042249 May 28 17:40:28.779872 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 604/1209] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:40:28.858175 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-119a9bc1-810a-41ce-a72c-c1c5ae34c914 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:40:28.866209 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-119a9bc1-810a-41ce-a72c-c1c5ae34c914 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd" status: 200 len: 1267 microversion: 2.1 time: 0.295602 May 28 17:40:28.867084 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 606/1210] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:40:28 2022] GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd => generated 1267 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:40:29.885831 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1e07aa6a-aa66-4a5c-81e4-2af1a402d537 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:40:29.886528 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1e07aa6a-aa66-4a5c-81e4-2af1a402d537 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 55b6f098-3687-4ce1-a74a-2e050591eddd] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:40:29.892702 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1e07aa6a-aa66-4a5c-81e4-2af1a402d537 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:29.893149 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1e07aa6a-aa66-4a5c-81e4-2af1a402d537 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:29.893901 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1e07aa6a-aa66-4a5c-81e4-2af1a402d537 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:29.894332 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1e07aa6a-aa66-4a5c-81e4-2af1a402d537 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:30.076794 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1e07aa6a-aa66-4a5c-81e4-2af1a402d537 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:40:30.084123 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1e07aa6a-aa66-4a5c-81e4-2af1a402d537 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd" status: 200 len: 1267 microversion: 2.1 time: 0.203197 May 28 17:40:30.084686 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 605/1211] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:40:29 2022] GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:40:31.101227 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2ae8ec37-00a4-41f4-988e-56aa940f6e03 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:40:31.101955 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2ae8ec37-00a4-41f4-988e-56aa940f6e03 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 55b6f098-3687-4ce1-a74a-2e050591eddd] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:40:31.108450 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2ae8ec37-00a4-41f4-988e-56aa940f6e03 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:31.108893 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2ae8ec37-00a4-41f4-988e-56aa940f6e03 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:31.109642 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2ae8ec37-00a4-41f4-988e-56aa940f6e03 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:31.110074 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2ae8ec37-00a4-41f4-988e-56aa940f6e03 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:31.240285 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-2ae8ec37-00a4-41f4-988e-56aa940f6e03 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:40:31.247851 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2ae8ec37-00a4-41f4-988e-56aa940f6e03 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd" status: 200 len: 1267 microversion: 2.1 time: 0.150452 May 28 17:40:31.248408 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 607/1212] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:40:31 2022] GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:40:32.264210 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-0ee14586-87b6-4b14-afb1-15b7fe0cfe0e tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:40:32.264823 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-0ee14586-87b6-4b14-afb1-15b7fe0cfe0e tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 55b6f098-3687-4ce1-a74a-2e050591eddd] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:40:32.271298 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0ee14586-87b6-4b14-afb1-15b7fe0cfe0e tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:32.271788 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0ee14586-87b6-4b14-afb1-15b7fe0cfe0e tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:32.272538 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0ee14586-87b6-4b14-afb1-15b7fe0cfe0e tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:32.272976 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-0ee14586-87b6-4b14-afb1-15b7fe0cfe0e tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:32.403041 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-0ee14586-87b6-4b14-afb1-15b7fe0cfe0e tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:40:32.410538 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-0ee14586-87b6-4b14-afb1-15b7fe0cfe0e tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd" status: 200 len: 1267 microversion: 2.1 time: 0.150186 May 28 17:40:32.411108 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 606/1213] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:40:32 2022] GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:40:33.427781 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-91e83785-8fec-43d5-90a2-5a09704387b7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:40:33.428406 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-91e83785-8fec-43d5-90a2-5a09704387b7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 55b6f098-3687-4ce1-a74a-2e050591eddd] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:40:33.435619 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-91e83785-8fec-43d5-90a2-5a09704387b7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:33.436078 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-91e83785-8fec-43d5-90a2-5a09704387b7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:33.436846 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-91e83785-8fec-43d5-90a2-5a09704387b7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:33.437289 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-91e83785-8fec-43d5-90a2-5a09704387b7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:33.565952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-91e83785-8fec-43d5-90a2-5a09704387b7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:40:33.574246 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-91e83785-8fec-43d5-90a2-5a09704387b7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd" status: 200 len: 1267 microversion: 2.1 time: 0.150283 May 28 17:40:33.574739 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 608/1214] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:40:33 2022] GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:40:34.590392 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-46899686-e930-45d2-a531-4fcc6da08454 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:40:34.590947 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-46899686-e930-45d2-a531-4fcc6da08454 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 55b6f098-3687-4ce1-a74a-2e050591eddd] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:40:34.598084 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-46899686-e930-45d2-a531-4fcc6da08454 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:34.598536 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-46899686-e930-45d2-a531-4fcc6da08454 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:34.599418 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-46899686-e930-45d2-a531-4fcc6da08454 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:34.599937 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-46899686-e930-45d2-a531-4fcc6da08454 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:34.733759 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-46899686-e930-45d2-a531-4fcc6da08454 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:40:34.741106 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-46899686-e930-45d2-a531-4fcc6da08454 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd" status: 200 len: 1267 microversion: 2.1 time: 0.154774 May 28 17:40:34.741664 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 607/1215] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:40:34 2022] GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:40:35.758646 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d541d873-8886-4c1e-a22d-ffb8d23e3a38 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:40:35.759250 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d541d873-8886-4c1e-a22d-ffb8d23e3a38 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 55b6f098-3687-4ce1-a74a-2e050591eddd] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:40:35.765736 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d541d873-8886-4c1e-a22d-ffb8d23e3a38 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:35.766180 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d541d873-8886-4c1e-a22d-ffb8d23e3a38 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:35.766960 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d541d873-8886-4c1e-a22d-ffb8d23e3a38 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:35.767412 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d541d873-8886-4c1e-a22d-ffb8d23e3a38 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:35.899529 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d541d873-8886-4c1e-a22d-ffb8d23e3a38 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:40:35.906917 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d541d873-8886-4c1e-a22d-ffb8d23e3a38 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd" status: 200 len: 1267 microversion: 2.1 time: 0.152596 May 28 17:40:35.907500 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 609/1216] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:40:35 2022] GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:40:36.923687 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9436aca3-6454-49a7-804a-df13381a7af3 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:40:36.924302 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9436aca3-6454-49a7-804a-df13381a7af3 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 55b6f098-3687-4ce1-a74a-2e050591eddd] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:40:36.926214 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=2 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:40:36.926866 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=6 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:40:36.933946 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9436aca3-6454-49a7-804a-df13381a7af3 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:36.934394 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9436aca3-6454-49a7-804a-df13381a7af3 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:36.935153 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9436aca3-6454-49a7-804a-df13381a7af3 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:36.935609 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9436aca3-6454-49a7-804a-df13381a7af3 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:37.064497 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-9436aca3-6454-49a7-804a-df13381a7af3 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:40:37.072138 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9436aca3-6454-49a7-804a-df13381a7af3 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd" status: 200 len: 1267 microversion: 2.1 time: 0.152317 May 28 17:40:37.072705 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 608/1217] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:40:36 2022] GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:40:38.088217 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-ed948f72-a5e5-4cb7-bbcf-a2ec79f78cd7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:40:38.088839 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-ed948f72-a5e5-4cb7-bbcf-a2ec79f78cd7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 55b6f098-3687-4ce1-a74a-2e050591eddd] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:40:38.090774 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:40:38.096592 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ed948f72-a5e5-4cb7-bbcf-a2ec79f78cd7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:38.097038 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ed948f72-a5e5-4cb7-bbcf-a2ec79f78cd7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:38.097795 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ed948f72-a5e5-4cb7-bbcf-a2ec79f78cd7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:38.098229 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-ed948f72-a5e5-4cb7-bbcf-a2ec79f78cd7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:38.236910 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-ed948f72-a5e5-4cb7-bbcf-a2ec79f78cd7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:40:38.244432 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-ed948f72-a5e5-4cb7-bbcf-a2ec79f78cd7 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd" status: 200 len: 1267 microversion: 2.1 time: 0.160353 May 28 17:40:38.244921 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 610/1218] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:40:38 2022] GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:40:39.264541 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-78fe9757-bd21-405d-9777-cef67e56030b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:40:39.265160 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-78fe9757-bd21-405d-9777-cef67e56030b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 55b6f098-3687-4ce1-a74a-2e050591eddd] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:40:39.271671 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-78fe9757-bd21-405d-9777-cef67e56030b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:39.272057 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-78fe9757-bd21-405d-9777-cef67e56030b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:39.272819 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-78fe9757-bd21-405d-9777-cef67e56030b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:39.273263 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-78fe9757-bd21-405d-9777-cef67e56030b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:39.406157 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-78fe9757-bd21-405d-9777-cef67e56030b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:40:39.413506 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-78fe9757-bd21-405d-9777-cef67e56030b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd" status: 200 len: 1267 microversion: 2.1 time: 0.152800 May 28 17:40:39.414043 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 609/1219] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:40:39 2022] GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:40:40.431679 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8254610c-de4e-4e7a-9c0c-72c4622de230 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:40:40.432297 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8254610c-de4e-4e7a-9c0c-72c4622de230 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 55b6f098-3687-4ce1-a74a-2e050591eddd] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:40:40.438901 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8254610c-de4e-4e7a-9c0c-72c4622de230 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:40.439367 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8254610c-de4e-4e7a-9c0c-72c4622de230 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:40.440140 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8254610c-de4e-4e7a-9c0c-72c4622de230 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:40.440576 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8254610c-de4e-4e7a-9c0c-72c4622de230 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:40.574628 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-8254610c-de4e-4e7a-9c0c-72c4622de230 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:40:40.582120 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8254610c-de4e-4e7a-9c0c-72c4622de230 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd" status: 200 len: 1267 microversion: 2.1 time: 0.154821 May 28 17:40:40.582687 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 611/1220] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:40:40 2022] GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:40:40.630038 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-7ad5abbb-5b1e-4ca5-9dfb-badff539d490 req-4efc22fe-6de7-4c4a-98d9-2f6ab0ee2f2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55b6f098-3687-4ce1-a74a-2e050591eddd", "name": "network-vif-plugged", "status": "completed", "tag": "5c34b26f-cf27-4dcb-bde9-01d75bac0901"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:40:40.640287 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-7ad5abbb-5b1e-4ca5-9dfb-badff539d490 req-4efc22fe-6de7-4c4a-98d9-2f6ab0ee2f2b service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:40.640739 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-7ad5abbb-5b1e-4ca5-9dfb-badff539d490 req-4efc22fe-6de7-4c4a-98d9-2f6ab0ee2f2b service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:40.654356 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-7ad5abbb-5b1e-4ca5-9dfb-badff539d490 req-4efc22fe-6de7-4c4a-98d9-2f6ab0ee2f2b service nova] Creating event network-vif-plugged:5c34b26f-cf27-4dcb-bde9-01d75bac0901 for instance 55b6f098-3687-4ce1-a74a-2e050591eddd on hv-cinder-84372 May 28 17:40:40.659648 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-7ad5abbb-5b1e-4ca5-9dfb-badff539d490 req-4efc22fe-6de7-4c4a-98d9-2f6ab0ee2f2b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033948 May 28 17:40:40.660247 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 610/1221] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:40:41.598727 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-7b74615a-1b82-4c6b-868e-6756ace2d754 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:40:41.599268 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-7b74615a-1b82-4c6b-868e-6756ace2d754 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 55b6f098-3687-4ce1-a74a-2e050591eddd] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:40:41.606465 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7b74615a-1b82-4c6b-868e-6756ace2d754 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:41.606922 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7b74615a-1b82-4c6b-868e-6756ace2d754 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:41.607882 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7b74615a-1b82-4c6b-868e-6756ace2d754 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:41.608670 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7b74615a-1b82-4c6b-868e-6756ace2d754 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:41.740224 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7b74615a-1b82-4c6b-868e-6756ace2d754 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:40:41.747667 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-7b74615a-1b82-4c6b-868e-6756ace2d754 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd" status: 200 len: 1267 microversion: 2.1 time: 0.152913 May 28 17:40:41.748237 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 612/1222] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:40:41 2022] GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:40:42.764540 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f360508d-dfe0-4207-b78b-bc232335704a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:40:42.765240 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f360508d-dfe0-4207-b78b-bc232335704a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 55b6f098-3687-4ce1-a74a-2e050591eddd] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:40:42.772528 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f360508d-dfe0-4207-b78b-bc232335704a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:42.773038 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f360508d-dfe0-4207-b78b-bc232335704a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:42.773835 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f360508d-dfe0-4207-b78b-bc232335704a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:42.774832 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-f360508d-dfe0-4207-b78b-bc232335704a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:42.906696 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f360508d-dfe0-4207-b78b-bc232335704a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:40:42.914218 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f360508d-dfe0-4207-b78b-bc232335704a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd" status: 200 len: 1454 microversion: 2.1 time: 0.153900 May 28 17:40:42.915600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 611/1223] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:40:42 2022] GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:40:42.931410 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-0b32838e-5f52-4c2d-af9a-4e52d49971e0 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:40:42.932035 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-0b32838e-5f52-4c2d-af9a-4e52d49971e0 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 55b6f098-3687-4ce1-a74a-2e050591eddd] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:40:42.938423 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0b32838e-5f52-4c2d-af9a-4e52d49971e0 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:42.938874 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0b32838e-5f52-4c2d-af9a-4e52d49971e0 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:42.939666 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0b32838e-5f52-4c2d-af9a-4e52d49971e0 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:42.940116 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-0b32838e-5f52-4c2d-af9a-4e52d49971e0 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:43.069425 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-0b32838e-5f52-4c2d-af9a-4e52d49971e0 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:40:43.077423 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-0b32838e-5f52-4c2d-af9a-4e52d49971e0 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd" status: 200 len: 1454 microversion: 2.1 time: 0.149926 May 28 17:40:43.078186 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 613/1224] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:40:42 2022] GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:40:44.950903 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-7635e120-1115-4bdf-b933-e3305238a309 req-2c9a21a7-63b9-4a96-9737-4cacb213ed28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55b6f098-3687-4ce1-a74a-2e050591eddd", "tag": "5c34b26f-cf27-4dcb-bde9-01d75bac0901"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:40:44.959226 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-7635e120-1115-4bdf-b933-e3305238a309 req-2c9a21a7-63b9-4a96-9737-4cacb213ed28 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:40:44.959705 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-7635e120-1115-4bdf-b933-e3305238a309 req-2c9a21a7-63b9-4a96-9737-4cacb213ed28 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:40:44.971227 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-7635e120-1115-4bdf-b933-e3305238a309 req-2c9a21a7-63b9-4a96-9737-4cacb213ed28 service nova] Creating event network-changed:5c34b26f-cf27-4dcb-bde9-01d75bac0901 for instance 55b6f098-3687-4ce1-a74a-2e050591eddd on hv-cinder-84372 May 28 17:40:44.976399 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-7635e120-1115-4bdf-b933-e3305238a309 req-2c9a21a7-63b9-4a96-9737-4cacb213ed28 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029422 May 28 17:40:44.978287 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 612/1225] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:41:12.087162 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-8af82c8e-5687-411a-af54-d8a5c990314f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:41:12.087773 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-8af82c8e-5687-411a-af54-d8a5c990314f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:41:12.090311 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=27 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:41:12.090954 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=63 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:41:12.097219 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8af82c8e-5687-411a-af54-d8a5c990314f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:12.097666 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8af82c8e-5687-411a-af54-d8a5c990314f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:12.098430 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8af82c8e-5687-411a-af54-d8a5c990314f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:12.098867 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-8af82c8e-5687-411a-af54-d8a5c990314f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:12.121958 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-8af82c8e-5687-411a-af54-d8a5c990314f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9/ips" status: 200 len: 149 microversion: 2.1 time: 0.038734 May 28 17:41:12.122512 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 614/1226] 10.222.0.33 () {58 vars in 1247 bytes} [Sat May 28 17:41:12 2022] GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:41:13.429050 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-47449244-9eea-4810-b259-912b3dd662c2 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c6e18e1-b58a-4641-8590-409665b5eb06"}} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:41:13.430197 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-47449244-9eea-4810-b259-912b3dd662c2 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:41:13.432487 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:41:13.433354 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:41:13.440011 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-47449244-9eea-4810-b259-912b3dd662c2 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:13.440464 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-47449244-9eea-4810-b259-912b3dd662c2 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:13.441226 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-47449244-9eea-4810-b259-912b3dd662c2 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:13.441662 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-47449244-9eea-4810-b259-912b3dd662c2 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:13.701087 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-47449244-9eea-4810-b259-912b3dd662c2 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "POST /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276129 May 28 17:41:13.701704 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 613/1227] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 17:41:13 2022] POST /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:41:21.326533 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-7ec11907-5558-4195-9d2b-f4fa72696e05 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:41:21.327049 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-7ec11907-5558-4195-9d2b-f4fa72696e05 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:41:21.333262 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7ec11907-5558-4195-9d2b-f4fa72696e05 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:21.333706 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7ec11907-5558-4195-9d2b-f4fa72696e05 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:21.334462 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7ec11907-5558-4195-9d2b-f4fa72696e05 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:21.334898 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7ec11907-5558-4195-9d2b-f4fa72696e05 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:21.414601 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.objects.instance [None req-7ec11907-5558-4195-9d2b-f4fa72696e05 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lazy-loading 'services' on Instance uuid c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 {{(pid=117604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 17:41:21.485866 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-7ec11907-5558-4195-9d2b-f4fa72696e05 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9/os-volume_attachments/1c6e18e1-b58a-4641-8590-409665b5eb06" status: 202 len: 0 microversion: 2.1 time: 0.163031 May 28 17:41:21.486520 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 615/1228] 10.222.0.33 () {58 vars in 1415 bytes} [Sat May 28 17:41:21 2022] DELETE /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9/os-volume_attachments/1c6e18e1-b58a-4641-8590-409665b5eb06 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 17:41:21.498581 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1b02aefc-18b3-44f0-ae96-dd244ed7ec9a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:41:21.500451 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1b02aefc-18b3-44f0-ae96-dd244ed7ec9a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:41:21.509998 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1b02aefc-18b3-44f0-ae96-dd244ed7ec9a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:21.510680 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1b02aefc-18b3-44f0-ae96-dd244ed7ec9a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:21.511914 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1b02aefc-18b3-44f0-ae96-dd244ed7ec9a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:21.512585 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1b02aefc-18b3-44f0-ae96-dd244ed7ec9a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:21.544154 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1b02aefc-18b3-44f0-ae96-dd244ed7ec9a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052588 May 28 17:41:21.545585 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 614/1229] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 17:41:21 2022] GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:41:22.557910 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-00d5a136-2435-463b-8eab-a0ab2634034c tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:41:22.558977 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-00d5a136-2435-463b-8eab-a0ab2634034c tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:41:22.566156 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-00d5a136-2435-463b-8eab-a0ab2634034c tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:22.566610 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-00d5a136-2435-463b-8eab-a0ab2634034c tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:22.567397 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-00d5a136-2435-463b-8eab-a0ab2634034c tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:22.567838 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-00d5a136-2435-463b-8eab-a0ab2634034c tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:22.596731 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-00d5a136-2435-463b-8eab-a0ab2634034c tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043834 May 28 17:41:22.597274 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 616/1230] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 17:41:22 2022] GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 17:41:22.655136 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-91cd1db7-eed5-48f5-b4cc-c14b536902a2 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:41:22.655674 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-91cd1db7-eed5-48f5-b4cc-c14b536902a2 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:41:22.662219 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-91cd1db7-eed5-48f5-b4cc-c14b536902a2 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:22.662676 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-91cd1db7-eed5-48f5-b4cc-c14b536902a2 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:22.663468 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-91cd1db7-eed5-48f5-b4cc-c14b536902a2 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:22.663915 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-91cd1db7-eed5-48f5-b4cc-c14b536902a2 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:22.689704 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-91cd1db7-eed5-48f5-b4cc-c14b536902a2 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9] Going to try to terminate instance {{(pid=117605) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 17:41:22.764072 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-91cd1db7-eed5-48f5-b4cc-c14b536902a2 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9" status: 204 len: 0 microversion: 2.1 time: 0.112333 May 28 17:41:22.764885 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 615/1231] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 17:41:22 2022] DELETE /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 17:41:22.773263 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-a5ce1024-5c1a-4101-9488-21fa0c5fc73a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:41:22.773869 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-a5ce1024-5c1a-4101-9488-21fa0c5fc73a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:41:22.779855 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a5ce1024-5c1a-4101-9488-21fa0c5fc73a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:22.780301 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a5ce1024-5c1a-4101-9488-21fa0c5fc73a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:22.781052 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a5ce1024-5c1a-4101-9488-21fa0c5fc73a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:22.781489 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-a5ce1024-5c1a-4101-9488-21fa0c5fc73a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:22.911362 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-a5ce1024-5c1a-4101-9488-21fa0c5fc73a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:41:22.918766 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-a5ce1024-5c1a-4101-9488-21fa0c5fc73a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9" status: 200 len: 1678 microversion: 2.1 time: 0.149326 May 28 17:41:22.919868 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 617/1232] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:41:22 2022] GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:41:23.937595 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9d9d4b16-2528-4b46-b878-b35b071d131f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:41:23.938290 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9d9d4b16-2528-4b46-b878-b35b071d131f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:41:23.944762 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9d9d4b16-2528-4b46-b878-b35b071d131f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:23.945209 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9d9d4b16-2528-4b46-b878-b35b071d131f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:23.945964 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9d9d4b16-2528-4b46-b878-b35b071d131f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:23.946398 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9d9d4b16-2528-4b46-b878-b35b071d131f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:24.078824 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-9d9d4b16-2528-4b46-b878-b35b071d131f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:41:24.086282 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9d9d4b16-2528-4b46-b878-b35b071d131f tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9" status: 200 len: 1678 microversion: 2.1 time: 0.153230 May 28 17:41:24.086854 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 616/1233] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:41:23 2022] GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:41:25.104188 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-7540bca3-660b-430a-a498-4030e37e935a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:41:25.104815 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-7540bca3-660b-430a-a498-4030e37e935a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:41:25.112002 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7540bca3-660b-430a-a498-4030e37e935a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:25.112456 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7540bca3-660b-430a-a498-4030e37e935a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:25.113224 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7540bca3-660b-430a-a498-4030e37e935a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:25.113665 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-7540bca3-660b-430a-a498-4030e37e935a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:25.269259 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-7540bca3-660b-430a-a498-4030e37e935a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7343386004e24474bc0af9126f47182b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9525b35792a04dc3a6f109cb39ee9d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:41:25.277008 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-7540bca3-660b-430a-a498-4030e37e935a tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9" status: 200 len: 1678 microversion: 2.1 time: 0.176674 May 28 17:41:25.277600 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 618/1234] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:41:25 2022] GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:41:25.598066 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [req-5ac6f83a-b880-4607-a90a-128d7b8144ec req-d7097451-7ee7-4e7f-8fa7-91dd350c384b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9", "name": "network-vif-deleted", "tag": "1799c11d-08f1-442a-b6df-9645693baeb0"}]} {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:41:25.607273 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-5ac6f83a-b880-4607-a90a-128d7b8144ec req-d7097451-7ee7-4e7f-8fa7-91dd350c384b service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:25.607828 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [req-5ac6f83a-b880-4607-a90a-128d7b8144ec req-d7097451-7ee7-4e7f-8fa7-91dd350c384b service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:25.622021 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.compute.server_external_events [req-5ac6f83a-b880-4607-a90a-128d7b8144ec req-d7097451-7ee7-4e7f-8fa7-91dd350c384b service nova] Creating event network-vif-deleted:1799c11d-08f1-442a-b6df-9645693baeb0 for instance c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 on hv-cinder-84372 May 28 17:41:25.627715 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [req-5ac6f83a-b880-4607-a90a-128d7b8144ec req-d7097451-7ee7-4e7f-8fa7-91dd350c384b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033617 May 28 17:41:25.628391 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 617/1235] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:41:26.293993 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-09c7eff4-ff6c-45a9-a209-1fa8c45e04be tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:41:26.295153 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-09c7eff4-ff6c-45a9-a209-1fa8c45e04be tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:41:26.301304 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-09c7eff4-ff6c-45a9-a209-1fa8c45e04be tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:26.301749 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-09c7eff4-ff6c-45a9-a209-1fa8c45e04be tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:26.302493 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-09c7eff4-ff6c-45a9-a209-1fa8c45e04be tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:26.302921 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-09c7eff4-ff6c-45a9-a209-1fa8c45e04be tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:26.317261 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-09c7eff4-ff6c-45a9-a209-1fa8c45e04be tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] HTTP exception thrown: Instance c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 could not be found. May 28 17:41:26.318884 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-09c7eff4-ff6c-45a9-a209-1fa8c45e04be tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Request method failure captured: May 28 17:41:26.318884 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 HTTP/1.1 May 28 17:41:26.318884 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:41:26.318884 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:41:26.318884 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:41:26.318884 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 0 May 28 17:41:26.318884 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:41:26.318884 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:41:26.318884 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:41:26.318884 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:41:26.318884 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABiklztpzsrcs87QXRJpScgk-5tUukjwPy1pG5nwYCeqw-1TdfbNHEPQv0dxfORMmAI_huWNfz4S1kkPQDKvHAPGaV0itPNNhduphbnIQQ9CdIotGmgnrod8uAS5LCp8f9bs3_RlkUgWcVbaRmZwj6AERxTjQmBOF2VAsv1p_k3m3IU8vI May 28 17:41:26.318884 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:41:26.318884 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:41:26.318884 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:41:26.318884 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:41:26.318884 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:41:26.318884 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:41:26.318884 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: 9525b35792a04dc3a6f109cb39ee9d50 May 28 17:41:26.318884 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:41:26.318884 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:41:26.318884 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:41:26.320697 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9525b35792a04dc3a6f109cb39ee9d50", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:41:26.320697 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:41:26.320697 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 9525b35792a04dc3a6f109cb39ee9d50 May 28 17:41:26.320697 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:41:26.320697 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-AttachVolumeNegativeTest-1796155594-project May 28 17:41:26.320697 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:41:26.320697 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:41:26.320697 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: 7343386004e24474bc0af9126f47182b May 28 17:41:26.320697 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-AttachVolumeNegativeTest-1796155594-project May 28 17:41:26.320697 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: > May 28 17:41:26.320697 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Instance c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 could not be found. May 28 17:41:26.320697 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'id': 'c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9'} May 28 17:41:26.321690 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:41:26.321690 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:41:26.321690 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:41:26.321690 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:41:26.321690 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:41:26.321690 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:41:26.321690 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:41:26.321690 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:41:26.321690 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:41:26.321690 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:41:26.321690 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 could not be found. May 28 17:41:26.321690 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:41:26.321690 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:41:26.321690 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:41:26.321690 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:41:26.321690 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:41:26.321690 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:41:26.321690 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:41:26.321690 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:41:26.321690 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:41:26.323288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:41:26.323288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:41:26.323288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:41:26.323288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:41:26.323288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:41:26.323288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:41:26.323288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:41:26.323288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 could not be found. May 28 17:41:26.323288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:41:26.323288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:41:26.323288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:41:26.323288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:41:26.323288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:41:26.323288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:41:26.323288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:41:26.323288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:41:26.323288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 could not be found. May 28 17:41:26.323288 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:41:26.325346 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-09c7eff4-ff6c-45a9-a209-1fa8c45e04be tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Returning 404 to user: Instance c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:41:26.325346 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-09c7eff4-ff6c-45a9-a209-1fa8c45e04be tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9" status: 404 len: 111 microversion: 2.1 time: 0.030265 May 28 17:41:26.325346 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 619/1236] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:41:26 2022] GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:41:26.332084 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-261ff711-c2af-4323-b228-0dc7957e940c tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '.version_select at 0x7f9f013f4e50>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:41:26.349935 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-261ff711-c2af-4323-b228-0dc7957e940c tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-57586635" status: 202 len: 0 microversion: 2.1 time: 0.021906 May 28 17:41:26.350763 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 618/1237] 10.222.0.33 () {58 vars in 1214 bytes} [Sat May 28 17:41:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-57586635 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 17:41:28.095794 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-fa3a77b0-69c6-48ce-b77c-492bb90e1b90 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:41:28.096321 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-fa3a77b0-69c6-48ce-b77c-492bb90e1b90 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:41:28.102751 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fa3a77b0-69c6-48ce-b77c-492bb90e1b90 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:28.103197 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fa3a77b0-69c6-48ce-b77c-492bb90e1b90 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:28.104010 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fa3a77b0-69c6-48ce-b77c-492bb90e1b90 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:28.104432 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fa3a77b0-69c6-48ce-b77c-492bb90e1b90 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:28.118098 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-fa3a77b0-69c6-48ce-b77c-492bb90e1b90 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] HTTP exception thrown: Instance c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 could not be found. May 28 17:41:28.119650 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-fa3a77b0-69c6-48ce-b77c-492bb90e1b90 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Request method failure captured: May 28 17:41:28.119650 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: DELETE /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 HTTP/1.1 May 28 17:41:28.119650 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:41:28.119650 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:41:28.119650 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:41:28.119650 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 0 May 28 17:41:28.119650 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:41:28.119650 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:41:28.119650 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:41:28.119650 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:41:28.119650 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABiklztpzsrcs87QXRJpScgk-5tUukjwPy1pG5nwYCeqw-1TdfbNHEPQv0dxfORMmAI_huWNfz4S1kkPQDKvHAPGaV0itPNNhduphbnIQQ9CdIotGmgnrod8uAS5LCp8f9bs3_RlkUgWcVbaRmZwj6AERxTjQmBOF2VAsv1p_k3m3IU8vI May 28 17:41:28.119650 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:41:28.119650 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:41:28.119650 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:41:28.119650 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:41:28.119650 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:41:28.119650 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:41:28.119650 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: 9525b35792a04dc3a6f109cb39ee9d50 May 28 17:41:28.119650 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:41:28.119650 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:41:28.119650 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:41:28.121346 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9525b35792a04dc3a6f109cb39ee9d50", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:41:28.121346 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:41:28.121346 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 9525b35792a04dc3a6f109cb39ee9d50 May 28 17:41:28.121346 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:41:28.121346 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-AttachVolumeNegativeTest-1796155594-project May 28 17:41:28.121346 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:41:28.121346 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:41:28.121346 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: 7343386004e24474bc0af9126f47182b May 28 17:41:28.121346 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-AttachVolumeNegativeTest-1796155594-project May 28 17:41:28.121346 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: > May 28 17:41:28.121346 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Instance c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 could not be found. May 28 17:41:28.121346 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'id': 'c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9'} May 28 17:41:28.122878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:41:28.122878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:41:28.122878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:41:28.122878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:41:28.122878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:41:28.122878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:41:28.122878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:41:28.122878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:41:28.122878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:41:28.122878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:41:28.122878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 could not be found. May 28 17:41:28.122878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:41:28.122878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:41:28.122878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:41:28.122878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:41:28.122878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:41:28.122878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:41:28.122878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:41:28.122878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:41:28.122878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:41:28.124525 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:41:28.124525 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 17:41:28.124525 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 17:41:28.124525 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 17:41:28.124525 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 17:41:28.124525 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:41:28.124525 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:41:28.124525 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:41:28.124525 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:41:28.124525 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 could not be found. May 28 17:41:28.124525 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:41:28.124525 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:41:28.124525 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:41:28.124525 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:41:28.124525 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:41:28.124525 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:41:28.124525 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:41:28.124525 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:41:28.124525 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 could not be found. May 28 17:41:28.124525 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:41:28.126149 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-fa3a77b0-69c6-48ce-b77c-492bb90e1b90 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Returning 404 to user: Instance c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:41:28.126149 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-fa3a77b0-69c6-48ce-b77c-492bb90e1b90 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9" status: 404 len: 111 microversion: 2.1 time: 0.029089 May 28 17:41:28.126149 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 620/1238] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 17:41:28 2022] DELETE /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:41:28.131110 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-70a695f2-6cb0-4f3c-99d0-6b9e28b09b20 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:41:28.131876 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-70a695f2-6cb0-4f3c-99d0-6b9e28b09b20 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:41:28.138760 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-70a695f2-6cb0-4f3c-99d0-6b9e28b09b20 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:28.139216 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-70a695f2-6cb0-4f3c-99d0-6b9e28b09b20 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:28.140014 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-70a695f2-6cb0-4f3c-99d0-6b9e28b09b20 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:28.140455 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-70a695f2-6cb0-4f3c-99d0-6b9e28b09b20 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:28.153415 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-70a695f2-6cb0-4f3c-99d0-6b9e28b09b20 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] HTTP exception thrown: Instance c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 could not be found. May 28 17:41:28.155025 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-70a695f2-6cb0-4f3c-99d0-6b9e28b09b20 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Request method failure captured: May 28 17:41:28.155025 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 HTTP/1.1 May 28 17:41:28.155025 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept: application/json May 28 17:41:28.155025 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity May 28 17:41:28.155025 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Connection: close May 28 17:41:28.155025 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Length: 0 May 28 17:41:28.155025 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Type: application/json May 28 17:41:28.155025 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 May 28 17:41:28.155025 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None May 28 17:41:28.155025 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 May 28 17:41:28.155025 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABiklztpzsrcs87QXRJpScgk-5tUukjwPy1pG5nwYCeqw-1TdfbNHEPQv0dxfORMmAI_huWNfz4S1kkPQDKvHAPGaV0itPNNhduphbnIQQ9CdIotGmgnrod8uAS5LCp8f9bs3_RlkUgWcVbaRmZwj6AERxTjQmBOF2VAsv1p_k3m3IU8vI May 28 17:41:28.155025 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Id: None May 28 17:41:28.155025 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Name: None May 28 17:41:28.155025 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed May 28 17:41:28.155025 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True May 28 17:41:28.155025 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default May 28 17:41:28.155025 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default May 28 17:41:28.155025 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Id: 9525b35792a04dc3a6f109cb39ee9d50 May 28 17:41:28.155025 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:41:28.155025 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Role: reader,member May 28 17:41:28.155025 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Roles: reader,member May 28 17:41:28.156679 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9525b35792a04dc3a6f109cb39ee9d50", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:41:28.156679 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:41:28.156679 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 9525b35792a04dc3a6f109cb39ee9d50 May 28 17:41:28.156679 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:41:28.156679 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeNegativeTest-1796155594-project May 28 17:41:28.156679 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default May 28 17:41:28.156679 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default May 28 17:41:28.156679 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Id: 7343386004e24474bc0af9126f47182b May 28 17:41:28.156679 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeNegativeTest-1796155594-project May 28 17:41:28.156679 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: method: > May 28 17:41:28.156679 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: exception: Instance c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 could not be found. May 28 17:41:28.156679 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: action_args: {'id': 'c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9'} May 28 17:41:28.157669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:41:28.157669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:41:28.157669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:41:28.157669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:41:28.157669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:41:28.157669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:41:28.157669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:41:28.157669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:41:28.157669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:41:28.157669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:41:28.157669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 could not be found. May 28 17:41:28.157669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:41:28.157669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:41:28.157669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:41:28.157669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:41:28.157669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:41:28.157669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:41:28.157669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:41:28.157669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:41:28.157669 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:41:28.159286 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:41:28.159286 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:41:28.159286 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:41:28.159286 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:41:28.159286 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:41:28.159286 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:41:28.159286 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:41:28.159286 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 could not be found. May 28 17:41:28.159286 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:41:28.159286 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:41:28.159286 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:41:28.159286 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:41:28.159286 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:41:28.159286 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:41:28.159286 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:41:28.159286 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:41:28.159286 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 could not be found. May 28 17:41:28.159286 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:41:28.160700 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-70a695f2-6cb0-4f3c-99d0-6b9e28b09b20 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Returning 404 to user: Instance c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:41:28.160700 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-70a695f2-6cb0-4f3c-99d0-6b9e28b09b20 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9" status: 404 len: 111 microversion: 2.1 time: 0.029162 May 28 17:41:28.160700 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 619/1239] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:41:28 2022] GET /compute/v2.1/servers/c1e64f3e-5e6f-4d61-97e0-ec917f5a45f9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:41:29.288089 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1d40f887-faf7-4dd8-95cf-5f9aa00208eb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:41:29.288617 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-1d40f887-faf7-4dd8-95cf-5f9aa00208eb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: d5769834-1cb8-4e14-b39e-9b1f8e359553] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:41:29.295180 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1d40f887-faf7-4dd8-95cf-5f9aa00208eb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:29.295670 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1d40f887-faf7-4dd8-95cf-5f9aa00208eb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:29.296433 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1d40f887-faf7-4dd8-95cf-5f9aa00208eb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:29.296872 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-1d40f887-faf7-4dd8-95cf-5f9aa00208eb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:29.310661 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-1d40f887-faf7-4dd8-95cf-5f9aa00208eb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] HTTP exception thrown: Instance d5769834-1cb8-4e14-b39e-9b1f8e359553 could not be found. May 28 17:41:29.312223 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1d40f887-faf7-4dd8-95cf-5f9aa00208eb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Request method failure captured: May 28 17:41:29.312223 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: DELETE /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553 HTTP/1.1 May 28 17:41:29.312223 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:41:29.312223 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:41:29.312223 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:41:29.312223 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 0 May 28 17:41:29.312223 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:41:29.312223 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:41:29.312223 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:41:29.312223 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:41:29.312223 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABiklztpzsrcs87QXRJpScgk-5tUukjwPy1pG5nwYCeqw-1TdfbNHEPQv0dxfORMmAI_huWNfz4S1kkPQDKvHAPGaV0itPNNhduphbnIQQ9CdIotGmgnrod8uAS5LCp8f9bs3_RlkUgWcVbaRmZwj6AERxTjQmBOF2VAsv1p_k3m3IU8vI May 28 17:41:29.312223 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:41:29.312223 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:41:29.312223 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:41:29.312223 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:41:29.312223 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:41:29.312223 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:41:29.312223 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: 9525b35792a04dc3a6f109cb39ee9d50 May 28 17:41:29.312223 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:41:29.312223 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:41:29.312223 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:41:29.313873 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9525b35792a04dc3a6f109cb39ee9d50", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:41:29.313873 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:41:29.313873 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 9525b35792a04dc3a6f109cb39ee9d50 May 28 17:41:29.313873 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:41:29.313873 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-AttachVolumeNegativeTest-1796155594-project May 28 17:41:29.313873 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:41:29.313873 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:41:29.313873 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: 7343386004e24474bc0af9126f47182b May 28 17:41:29.313873 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-AttachVolumeNegativeTest-1796155594-project May 28 17:41:29.313873 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: > May 28 17:41:29.313873 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Instance d5769834-1cb8-4e14-b39e-9b1f8e359553 could not be found. May 28 17:41:29.313873 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'id': 'd5769834-1cb8-4e14-b39e-9b1f8e359553'} May 28 17:41:29.314878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:41:29.314878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:41:29.314878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:41:29.314878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:41:29.314878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:41:29.314878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:41:29.314878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:41:29.314878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:41:29.314878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:41:29.314878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:41:29.314878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5769834-1cb8-4e14-b39e-9b1f8e359553 could not be found. May 28 17:41:29.314878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:41:29.314878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:41:29.314878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:41:29.314878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:41:29.314878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:41:29.314878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:41:29.314878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:41:29.314878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:41:29.314878 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:41:29.316431 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:41:29.316431 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 17:41:29.316431 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 17:41:29.316431 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 17:41:29.316431 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 17:41:29.316431 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:41:29.316431 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:41:29.316431 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:41:29.316431 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:41:29.316431 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5769834-1cb8-4e14-b39e-9b1f8e359553 could not be found. May 28 17:41:29.316431 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:41:29.316431 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:41:29.316431 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:41:29.316431 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:41:29.316431 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:41:29.316431 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:41:29.316431 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:41:29.316431 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:41:29.316431 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5769834-1cb8-4e14-b39e-9b1f8e359553 could not be found. May 28 17:41:29.316431 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:41:29.317968 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-1d40f887-faf7-4dd8-95cf-5f9aa00208eb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Returning 404 to user: Instance d5769834-1cb8-4e14-b39e-9b1f8e359553 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:41:29.317968 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-1d40f887-faf7-4dd8-95cf-5f9aa00208eb tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553" status: 404 len: 111 microversion: 2.1 time: 0.029400 May 28 17:41:29.317968 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 621/1240] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 17:41:29 2022] DELETE /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:41:29.321812 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-38e46213-5ca0-4c23-bfe6-6042e20411f4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:41:29.322430 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-38e46213-5ca0-4c23-bfe6-6042e20411f4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: d5769834-1cb8-4e14-b39e-9b1f8e359553] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:41:29.329485 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-38e46213-5ca0-4c23-bfe6-6042e20411f4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:29.329939 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-38e46213-5ca0-4c23-bfe6-6042e20411f4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:29.330700 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-38e46213-5ca0-4c23-bfe6-6042e20411f4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:29.331142 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-38e46213-5ca0-4c23-bfe6-6042e20411f4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:29.344367 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-38e46213-5ca0-4c23-bfe6-6042e20411f4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] HTTP exception thrown: Instance d5769834-1cb8-4e14-b39e-9b1f8e359553 could not be found. May 28 17:41:29.345875 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-38e46213-5ca0-4c23-bfe6-6042e20411f4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Request method failure captured: May 28 17:41:29.345875 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553 HTTP/1.1 May 28 17:41:29.345875 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept: application/json May 28 17:41:29.345875 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity May 28 17:41:29.345875 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Connection: close May 28 17:41:29.345875 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Length: 0 May 28 17:41:29.345875 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Type: application/json May 28 17:41:29.345875 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 May 28 17:41:29.345875 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None May 28 17:41:29.345875 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 May 28 17:41:29.345875 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABiklztpzsrcs87QXRJpScgk-5tUukjwPy1pG5nwYCeqw-1TdfbNHEPQv0dxfORMmAI_huWNfz4S1kkPQDKvHAPGaV0itPNNhduphbnIQQ9CdIotGmgnrod8uAS5LCp8f9bs3_RlkUgWcVbaRmZwj6AERxTjQmBOF2VAsv1p_k3m3IU8vI May 28 17:41:29.345875 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Id: None May 28 17:41:29.345875 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Name: None May 28 17:41:29.345875 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed May 28 17:41:29.345875 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True May 28 17:41:29.345875 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default May 28 17:41:29.345875 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default May 28 17:41:29.345875 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Id: 9525b35792a04dc3a6f109cb39ee9d50 May 28 17:41:29.345875 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:41:29.345875 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Role: reader,member May 28 17:41:29.345875 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Roles: reader,member May 28 17:41:29.347519 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9525b35792a04dc3a6f109cb39ee9d50", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:41:29.347519 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:41:29.347519 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 9525b35792a04dc3a6f109cb39ee9d50 May 28 17:41:29.347519 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:41:29.347519 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeNegativeTest-1796155594-project May 28 17:41:29.347519 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default May 28 17:41:29.347519 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default May 28 17:41:29.347519 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Id: 7343386004e24474bc0af9126f47182b May 28 17:41:29.347519 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeNegativeTest-1796155594-project May 28 17:41:29.347519 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: method: > May 28 17:41:29.347519 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: exception: Instance d5769834-1cb8-4e14-b39e-9b1f8e359553 could not be found. May 28 17:41:29.347519 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: action_args: {'id': 'd5769834-1cb8-4e14-b39e-9b1f8e359553'} May 28 17:41:29.348462 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:41:29.348462 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:41:29.348462 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:41:29.348462 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:41:29.348462 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:41:29.348462 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:41:29.348462 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:41:29.348462 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:41:29.348462 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:41:29.348462 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:41:29.348462 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5769834-1cb8-4e14-b39e-9b1f8e359553 could not be found. May 28 17:41:29.348462 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:41:29.348462 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:41:29.348462 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:41:29.348462 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:41:29.348462 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:41:29.348462 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:41:29.348462 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:41:29.348462 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:41:29.348462 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:41:29.349965 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:41:29.349965 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:41:29.349965 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:41:29.349965 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:41:29.349965 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:41:29.349965 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:41:29.349965 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:41:29.349965 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5769834-1cb8-4e14-b39e-9b1f8e359553 could not be found. May 28 17:41:29.349965 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:41:29.349965 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:41:29.349965 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:41:29.349965 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:41:29.349965 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:41:29.349965 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:41:29.349965 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:41:29.349965 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:41:29.349965 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5769834-1cb8-4e14-b39e-9b1f8e359553 could not be found. May 28 17:41:29.349965 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:41:29.351671 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-38e46213-5ca0-4c23-bfe6-6042e20411f4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Returning 404 to user: Instance d5769834-1cb8-4e14-b39e-9b1f8e359553 could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:41:29.351671 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-38e46213-5ca0-4c23-bfe6-6042e20411f4 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553" status: 404 len: 111 microversion: 2.1 time: 0.029228 May 28 17:41:29.351671 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 620/1241] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:41:29 2022] GET /compute/v2.1/servers/d5769834-1cb8-4e14-b39e-9b1f8e359553 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:41:29.355740 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6afb7a10-1dec-4e26-803e-5e869830e2d0 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:41:29.356418 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-6afb7a10-1dec-4e26-803e-5e869830e2d0 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:41:29.362856 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6afb7a10-1dec-4e26-803e-5e869830e2d0 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:29.363300 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6afb7a10-1dec-4e26-803e-5e869830e2d0 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:29.364077 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6afb7a10-1dec-4e26-803e-5e869830e2d0 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:29.364507 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-6afb7a10-1dec-4e26-803e-5e869830e2d0 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:29.378887 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-6afb7a10-1dec-4e26-803e-5e869830e2d0 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] HTTP exception thrown: Instance 9a72ea47-a87d-4716-981b-423fe0a0d60d could not be found. May 28 17:41:29.381096 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6afb7a10-1dec-4e26-803e-5e869830e2d0 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Request method failure captured: May 28 17:41:29.381096 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: DELETE /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d HTTP/1.1 May 28 17:41:29.381096 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:41:29.381096 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:41:29.381096 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:41:29.381096 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 0 May 28 17:41:29.381096 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:41:29.381096 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:41:29.381096 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:41:29.381096 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:41:29.381096 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABiklztpzsrcs87QXRJpScgk-5tUukjwPy1pG5nwYCeqw-1TdfbNHEPQv0dxfORMmAI_huWNfz4S1kkPQDKvHAPGaV0itPNNhduphbnIQQ9CdIotGmgnrod8uAS5LCp8f9bs3_RlkUgWcVbaRmZwj6AERxTjQmBOF2VAsv1p_k3m3IU8vI May 28 17:41:29.381096 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:41:29.381096 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:41:29.381096 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:41:29.381096 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:41:29.381096 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:41:29.381096 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:41:29.381096 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: 9525b35792a04dc3a6f109cb39ee9d50 May 28 17:41:29.381096 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:41:29.381096 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:41:29.381096 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:41:29.383807 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9525b35792a04dc3a6f109cb39ee9d50", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:41:29.383807 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:41:29.383807 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 9525b35792a04dc3a6f109cb39ee9d50 May 28 17:41:29.383807 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:41:29.383807 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-AttachVolumeNegativeTest-1796155594-project May 28 17:41:29.383807 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:41:29.383807 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:41:29.383807 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: 7343386004e24474bc0af9126f47182b May 28 17:41:29.383807 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-AttachVolumeNegativeTest-1796155594-project May 28 17:41:29.383807 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: > May 28 17:41:29.383807 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Instance 9a72ea47-a87d-4716-981b-423fe0a0d60d could not be found. May 28 17:41:29.383807 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'id': '9a72ea47-a87d-4716-981b-423fe0a0d60d'} May 28 17:41:29.385285 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:41:29.385285 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:41:29.385285 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:41:29.385285 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:41:29.385285 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:41:29.385285 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:41:29.385285 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:41:29.385285 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:41:29.385285 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:41:29.385285 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:41:29.385285 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a72ea47-a87d-4716-981b-423fe0a0d60d could not be found. May 28 17:41:29.385285 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:41:29.385285 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:41:29.385285 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:41:29.385285 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:41:29.385285 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:41:29.385285 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:41:29.385285 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:41:29.385285 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:41:29.385285 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:41:29.388069 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:41:29.388069 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 17:41:29.388069 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 17:41:29.388069 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 17:41:29.388069 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 17:41:29.388069 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:41:29.388069 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:41:29.388069 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:41:29.388069 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:41:29.388069 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a72ea47-a87d-4716-981b-423fe0a0d60d could not be found. May 28 17:41:29.388069 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:41:29.388069 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:41:29.388069 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:41:29.388069 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:41:29.388069 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:41:29.388069 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:41:29.388069 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:41:29.388069 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:41:29.388069 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a72ea47-a87d-4716-981b-423fe0a0d60d could not be found. May 28 17:41:29.388069 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:41:29.390771 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-6afb7a10-1dec-4e26-803e-5e869830e2d0 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Returning 404 to user: Instance 9a72ea47-a87d-4716-981b-423fe0a0d60d could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:41:29.390771 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-6afb7a10-1dec-4e26-803e-5e869830e2d0 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d" status: 404 len: 111 microversion: 2.1 time: 0.030617 May 28 17:41:29.390771 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 622/1242] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 17:41:29 2022] DELETE /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:41:29.393655 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-866df210-7cab-4263-a298-830344a39eb3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:41:29.394274 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-866df210-7cab-4263-a298-830344a39eb3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 9a72ea47-a87d-4716-981b-423fe0a0d60d] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:41:29.400345 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-866df210-7cab-4263-a298-830344a39eb3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:29.400794 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-866df210-7cab-4263-a298-830344a39eb3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:29.401553 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-866df210-7cab-4263-a298-830344a39eb3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:29.401988 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-866df210-7cab-4263-a298-830344a39eb3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:29.415525 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-866df210-7cab-4263-a298-830344a39eb3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] HTTP exception thrown: Instance 9a72ea47-a87d-4716-981b-423fe0a0d60d could not be found. May 28 17:41:29.417061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-866df210-7cab-4263-a298-830344a39eb3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Request method failure captured: May 28 17:41:29.417061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d HTTP/1.1 May 28 17:41:29.417061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept: application/json May 28 17:41:29.417061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity May 28 17:41:29.417061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Connection: close May 28 17:41:29.417061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Length: 0 May 28 17:41:29.417061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Type: application/json May 28 17:41:29.417061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 May 28 17:41:29.417061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None May 28 17:41:29.417061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 May 28 17:41:29.417061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABiklztpzsrcs87QXRJpScgk-5tUukjwPy1pG5nwYCeqw-1TdfbNHEPQv0dxfORMmAI_huWNfz4S1kkPQDKvHAPGaV0itPNNhduphbnIQQ9CdIotGmgnrod8uAS5LCp8f9bs3_RlkUgWcVbaRmZwj6AERxTjQmBOF2VAsv1p_k3m3IU8vI May 28 17:41:29.417061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Id: None May 28 17:41:29.417061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Name: None May 28 17:41:29.417061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed May 28 17:41:29.417061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True May 28 17:41:29.417061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default May 28 17:41:29.417061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default May 28 17:41:29.417061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Id: 9525b35792a04dc3a6f109cb39ee9d50 May 28 17:41:29.417061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:41:29.417061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Role: reader,member May 28 17:41:29.417061 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Roles: reader,member May 28 17:41:29.419520 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9525b35792a04dc3a6f109cb39ee9d50", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:41:29.419520 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:41:29.419520 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 9525b35792a04dc3a6f109cb39ee9d50 May 28 17:41:29.419520 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:41:29.419520 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeNegativeTest-1796155594-project May 28 17:41:29.419520 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default May 28 17:41:29.419520 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default May 28 17:41:29.419520 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Id: 7343386004e24474bc0af9126f47182b May 28 17:41:29.419520 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeNegativeTest-1796155594-project May 28 17:41:29.419520 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: method: > May 28 17:41:29.419520 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: exception: Instance 9a72ea47-a87d-4716-981b-423fe0a0d60d could not be found. May 28 17:41:29.419520 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: action_args: {'id': '9a72ea47-a87d-4716-981b-423fe0a0d60d'} May 28 17:41:29.420379 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:41:29.420379 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:41:29.420379 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:41:29.420379 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:41:29.420379 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:41:29.420379 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:41:29.420379 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:41:29.420379 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:41:29.420379 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:41:29.420379 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:41:29.420379 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a72ea47-a87d-4716-981b-423fe0a0d60d could not be found. May 28 17:41:29.420379 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:41:29.420379 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:41:29.420379 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:41:29.420379 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:41:29.420379 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:41:29.420379 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:41:29.420379 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:41:29.420379 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:41:29.420379 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:41:29.421890 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:41:29.421890 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:41:29.421890 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:41:29.421890 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:41:29.421890 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:41:29.421890 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:41:29.421890 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:41:29.421890 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a72ea47-a87d-4716-981b-423fe0a0d60d could not be found. May 28 17:41:29.421890 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:41:29.421890 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:41:29.421890 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:41:29.421890 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:41:29.421890 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:41:29.421890 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:41:29.421890 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:41:29.421890 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:41:29.421890 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a72ea47-a87d-4716-981b-423fe0a0d60d could not be found. May 28 17:41:29.421890 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:41:29.424242 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-866df210-7cab-4263-a298-830344a39eb3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Returning 404 to user: Instance 9a72ea47-a87d-4716-981b-423fe0a0d60d could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:41:29.424242 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-866df210-7cab-4263-a298-830344a39eb3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d" status: 404 len: 111 microversion: 2.1 time: 0.030228 May 28 17:41:29.424242 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 621/1243] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:41:29 2022] GET /compute/v2.1/servers/9a72ea47-a87d-4716-981b-423fe0a0d60d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:41:30.551166 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e6b8f299-cae2-418f-90b4-1a91537f1eff tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:41:30.551673 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e6b8f299-cae2-418f-90b4-1a91537f1eff tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 6863e51f-850f-4d83-a5ea-34408f176184] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:41:30.558059 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e6b8f299-cae2-418f-90b4-1a91537f1eff tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:30.558500 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e6b8f299-cae2-418f-90b4-1a91537f1eff tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:30.559260 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e6b8f299-cae2-418f-90b4-1a91537f1eff tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:30.560258 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e6b8f299-cae2-418f-90b4-1a91537f1eff tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:30.573442 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-e6b8f299-cae2-418f-90b4-1a91537f1eff tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] HTTP exception thrown: Instance 6863e51f-850f-4d83-a5ea-34408f176184 could not be found. May 28 17:41:30.574973 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e6b8f299-cae2-418f-90b4-1a91537f1eff tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Request method failure captured: May 28 17:41:30.574973 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: DELETE /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184 HTTP/1.1 May 28 17:41:30.574973 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:41:30.574973 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:41:30.574973 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:41:30.574973 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 0 May 28 17:41:30.574973 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:41:30.574973 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:41:30.574973 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:41:30.574973 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:41:30.574973 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABiklztpzsrcs87QXRJpScgk-5tUukjwPy1pG5nwYCeqw-1TdfbNHEPQv0dxfORMmAI_huWNfz4S1kkPQDKvHAPGaV0itPNNhduphbnIQQ9CdIotGmgnrod8uAS5LCp8f9bs3_RlkUgWcVbaRmZwj6AERxTjQmBOF2VAsv1p_k3m3IU8vI May 28 17:41:30.574973 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:41:30.574973 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:41:30.574973 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:41:30.574973 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:41:30.574973 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:41:30.574973 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:41:30.574973 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: 9525b35792a04dc3a6f109cb39ee9d50 May 28 17:41:30.574973 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:41:30.574973 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:41:30.574973 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:41:30.577401 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9525b35792a04dc3a6f109cb39ee9d50", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:41:30.577401 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:41:30.577401 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 9525b35792a04dc3a6f109cb39ee9d50 May 28 17:41:30.577401 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:41:30.577401 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-AttachVolumeNegativeTest-1796155594-project May 28 17:41:30.577401 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:41:30.577401 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:41:30.577401 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: 7343386004e24474bc0af9126f47182b May 28 17:41:30.577401 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-AttachVolumeNegativeTest-1796155594-project May 28 17:41:30.577401 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: > May 28 17:41:30.577401 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Instance 6863e51f-850f-4d83-a5ea-34408f176184 could not be found. May 28 17:41:30.577401 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'id': '6863e51f-850f-4d83-a5ea-34408f176184'} May 28 17:41:30.578374 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:41:30.578374 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:41:30.578374 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:41:30.578374 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:41:30.578374 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:41:30.578374 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:41:30.578374 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:41:30.578374 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:41:30.578374 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:41:30.578374 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:41:30.578374 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6863e51f-850f-4d83-a5ea-34408f176184 could not be found. May 28 17:41:30.578374 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:41:30.578374 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:41:30.578374 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:41:30.578374 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:41:30.578374 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:41:30.578374 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:41:30.578374 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:41:30.578374 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:41:30.578374 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:41:30.579952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:41:30.579952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 17:41:30.579952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 17:41:30.579952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 17:41:30.579952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 17:41:30.579952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:41:30.579952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:41:30.579952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:41:30.579952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:41:30.579952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6863e51f-850f-4d83-a5ea-34408f176184 could not be found. May 28 17:41:30.579952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:41:30.579952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:41:30.579952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:41:30.579952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:41:30.579952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:41:30.579952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:41:30.579952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:41:30.579952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:41:30.579952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6863e51f-850f-4d83-a5ea-34408f176184 could not be found. May 28 17:41:30.579952 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:41:30.581761 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e6b8f299-cae2-418f-90b4-1a91537f1eff tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Returning 404 to user: Instance 6863e51f-850f-4d83-a5ea-34408f176184 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:41:30.581761 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e6b8f299-cae2-418f-90b4-1a91537f1eff tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184" status: 404 len: 111 microversion: 2.1 time: 0.029842 May 28 17:41:30.581761 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 623/1244] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 17:41:30 2022] DELETE /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:41:30.585327 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-92651302-45b0-4050-87da-3789b4041cb3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:41:30.585946 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-92651302-45b0-4050-87da-3789b4041cb3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] [instance: 6863e51f-850f-4d83-a5ea-34408f176184] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:41:30.592309 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-92651302-45b0-4050-87da-3789b4041cb3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:30.592762 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-92651302-45b0-4050-87da-3789b4041cb3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:30.593519 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-92651302-45b0-4050-87da-3789b4041cb3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:41:30.593958 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-92651302-45b0-4050-87da-3789b4041cb3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:41:30.607596 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-92651302-45b0-4050-87da-3789b4041cb3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] HTTP exception thrown: Instance 6863e51f-850f-4d83-a5ea-34408f176184 could not be found. May 28 17:41:30.609112 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-92651302-45b0-4050-87da-3789b4041cb3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Request method failure captured: May 28 17:41:30.609112 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: request: GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184 HTTP/1.1 May 28 17:41:30.609112 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept: application/json May 28 17:41:30.609112 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity May 28 17:41:30.609112 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Connection: close May 28 17:41:30.609112 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Length: 0 May 28 17:41:30.609112 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Type: application/json May 28 17:41:30.609112 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 May 28 17:41:30.609112 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None May 28 17:41:30.609112 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 May 28 17:41:30.609112 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABiklztpzsrcs87QXRJpScgk-5tUukjwPy1pG5nwYCeqw-1TdfbNHEPQv0dxfORMmAI_huWNfz4S1kkPQDKvHAPGaV0itPNNhduphbnIQQ9CdIotGmgnrod8uAS5LCp8f9bs3_RlkUgWcVbaRmZwj6AERxTjQmBOF2VAsv1p_k3m3IU8vI May 28 17:41:30.609112 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Id: None May 28 17:41:30.609112 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Name: None May 28 17:41:30.609112 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed May 28 17:41:30.609112 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True May 28 17:41:30.609112 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default May 28 17:41:30.609112 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default May 28 17:41:30.609112 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Id: 9525b35792a04dc3a6f109cb39ee9d50 May 28 17:41:30.609112 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:41:30.609112 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Role: reader,member May 28 17:41:30.609112 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Roles: reader,member May 28 17:41:30.610730 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9525b35792a04dc3a6f109cb39ee9d50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9525b35792a04dc3a6f109cb39ee9d50", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:41:30.610730 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:41:30.610730 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 9525b35792a04dc3a6f109cb39ee9d50 May 28 17:41:30.610730 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1796155594 May 28 17:41:30.610730 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User: tempest-AttachVolumeNegativeTest-1796155594-project May 28 17:41:30.610730 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default May 28 17:41:30.610730 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default May 28 17:41:30.610730 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Id: 7343386004e24474bc0af9126f47182b May 28 17:41:30.610730 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-AttachVolumeNegativeTest-1796155594-project May 28 17:41:30.610730 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: method: > May 28 17:41:30.610730 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: exception: Instance 6863e51f-850f-4d83-a5ea-34408f176184 could not be found. May 28 17:41:30.610730 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: action_args: {'id': '6863e51f-850f-4d83-a5ea-34408f176184'} May 28 17:41:30.611736 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:41:30.611736 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:41:30.611736 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:41:30.611736 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:41:30.611736 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:41:30.611736 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:41:30.611736 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:41:30.611736 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:41:30.611736 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:41:30.611736 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:41:30.611736 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6863e51f-850f-4d83-a5ea-34408f176184 could not be found. May 28 17:41:30.611736 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:41:30.611736 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:41:30.611736 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:41:30.611736 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:41:30.611736 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:41:30.611736 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:41:30.611736 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:41:30.611736 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:41:30.611736 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:41:30.613778 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:41:30.613778 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:41:30.613778 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:41:30.613778 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:41:30.613778 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:41:30.613778 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:41:30.613778 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:41:30.613778 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6863e51f-850f-4d83-a5ea-34408f176184 could not be found. May 28 17:41:30.613778 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:41:30.613778 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:41:30.613778 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:41:30.613778 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:41:30.613778 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:41:30.613778 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:41:30.613778 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:41:30.613778 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:41:30.613778 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6863e51f-850f-4d83-a5ea-34408f176184 could not be found. May 28 17:41:30.613778 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:41:30.615174 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-92651302-45b0-4050-87da-3789b4041cb3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] Returning 404 to user: Instance 6863e51f-850f-4d83-a5ea-34408f176184 could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:41:30.615174 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-92651302-45b0-4050-87da-3789b4041cb3 tempest-AttachVolumeNegativeTest-1796155594 tempest-AttachVolumeNegativeTest-1796155594-project] 10.222.0.33 "GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184" status: 404 len: 111 microversion: 2.1 time: 0.028979 May 28 17:41:30.615174 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 622/1245] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:41:30 2022] GET /compute/v2.1/servers/6863e51f-850f-4d83-a5ea-34408f176184 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:42:30.745540 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 17:42:30.746033 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Sat May 28 17:42:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 17:42:49.518694 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 17:42:49.519364 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Sat May 28 17:42:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 17:42:57.559705 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=20 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:42:57.560441 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:42:57.567057 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f8de0c94-99c0-48c0-a7e3-f290566d4c32 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1345833907", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1169689163", "security_groups": [{"name": "tempest-secgroup-smoke-1697074357"}], "block_device_mapping_v2": [{"uuid": "dc388f69-580d-4e25-a9ce-e7d8b4608b53", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a98bf986-b097-428c-84c6-2a59a4df1a9f"}]}} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:42:57.681598 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.network.neutron [None req-f8de0c94-99c0-48c0-a7e3-f290566d4c32 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] validate_networks() for [('a98bf986-b097-428c-84c6-2a59a4df1a9f', None, None, None, None, None)] {{(pid=117604) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 17:42:58.051064 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-f8de0c94-99c0-48c0-a7e3-f290566d4c32 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Flavor limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 17:42:58.051520 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-f8de0c94-99c0-48c0-a7e3-f290566d4c32 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Image limits 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 17:42:58.051993 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-f8de0c94-99c0-48c0-a7e3-f290566d4c32 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Flavor pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 17:42:58.052399 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-f8de0c94-99c0-48c0-a7e3-f290566d4c32 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Image pref 0:0:0 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 17:42:58.052805 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.virt.hardware [None req-f8de0c94-99c0-48c0-a7e3-f290566d4c32 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 17:42:58.061369 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f8de0c94-99c0-48c0-a7e3-f290566d4c32 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:42:58.062389 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f8de0c94-99c0-48c0-a7e3-f290566d4c32 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:42:58.063173 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f8de0c94-99c0-48c0-a7e3-f290566d4c32 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:42:58.063636 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f8de0c94-99c0-48c0-a7e3-f290566d4c32 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:42:58.079681 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-f8de0c94-99c0-48c0-a7e3-f290566d4c32 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Getting quotas for project 3785f78e6d1048cfa0b5b123fdd909c8. Resources: {'instances', 'cores', 'ram'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 17:42:58.083501 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.quota [None req-f8de0c94-99c0-48c0-a7e3-f290566d4c32 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Getting quotas for user 4a827bedc4b84508bb7770a09efee3f5 and project 3785f78e6d1048cfa0b5b123fdd909c8. Resources: {'instances', 'cores', 'ram'} {{(pid=117604) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 17:42:58.144309 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f8de0c94-99c0-48c0-a7e3-f290566d4c32 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Going to run 1 instances... {{(pid=117604) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 17:42:58.146415 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f8de0c94-99c0-48c0-a7e3-f290566d4c32 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: ed659e94-1255-44d1-9f29-3acf52af9a8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dc388f69-580d-4e25-a9ce-e7d8b4608b53',volume_size=None,volume_type=None)] {{(pid=117604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 17:42:58.274917 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f8de0c94-99c0-48c0-a7e3-f290566d4c32 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.717180 May 28 17:42:58.275569 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 624/1246] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 17:42:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 17:42:58.284198 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:42:58.285366 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:42:58.289633 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-f9adff1e-3e97-43a1-9f8c-afbe6ede30b0 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:42:58.290247 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-f9adff1e-3e97-43a1-9f8c-afbe6ede30b0 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: ed659e94-1255-44d1-9f29-3acf52af9a8b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:42:58.346981 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-f9adff1e-3e97-43a1-9f8c-afbe6ede30b0 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:42:58.353654 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-f9adff1e-3e97-43a1-9f8c-afbe6ede30b0 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b" status: 200 len: 1095 microversion: 2.1 time: 0.071485 May 28 17:42:58.354213 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 623/1247] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:42:58 2022] GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 17:42:59.371652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-14d1bd49-2498-499b-a6ab-89c90fb56bdd tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:42:59.372256 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-14d1bd49-2498-499b-a6ab-89c90fb56bdd tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: ed659e94-1255-44d1-9f29-3acf52af9a8b] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:42:59.379897 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-14d1bd49-2498-499b-a6ab-89c90fb56bdd tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:42:59.380349 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-14d1bd49-2498-499b-a6ab-89c90fb56bdd tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:42:59.381118 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-14d1bd49-2498-499b-a6ab-89c90fb56bdd tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:42:59.381555 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-14d1bd49-2498-499b-a6ab-89c90fb56bdd tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:42:59.449624 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-14d1bd49-2498-499b-a6ab-89c90fb56bdd tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:42:59.459535 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-14d1bd49-2498-499b-a6ab-89c90fb56bdd tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b" status: 200 len: 1211 microversion: 2.1 time: 0.092346 May 28 17:42:59.460534 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 625/1248] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:42:59 2022] GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b => generated 1211 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:43:00.476930 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1abc8474-17b7-4fcf-a4ba-5fd8c00b5d61 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:43:00.478142 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1abc8474-17b7-4fcf-a4ba-5fd8c00b5d61 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: ed659e94-1255-44d1-9f29-3acf52af9a8b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:43:00.486158 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1abc8474-17b7-4fcf-a4ba-5fd8c00b5d61 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:43:00.486620 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1abc8474-17b7-4fcf-a4ba-5fd8c00b5d61 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:43:00.487504 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1abc8474-17b7-4fcf-a4ba-5fd8c00b5d61 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:43:00.487919 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1abc8474-17b7-4fcf-a4ba-5fd8c00b5d61 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:43:00.706293 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1abc8474-17b7-4fcf-a4ba-5fd8c00b5d61 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:43:00.714779 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1abc8474-17b7-4fcf-a4ba-5fd8c00b5d61 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b" status: 200 len: 1267 microversion: 2.1 time: 0.241622 May 28 17:43:00.715930 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 624/1249] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:43:00 2022] GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b => generated 1267 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:43:00.978912 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-bc1e8010-9da0-4f72-a0ff-2fa7336096e7 req-3bf478f6-c963-4222-a92e-44086cf467c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed659e94-1255-44d1-9f29-3acf52af9a8b", "tag": "dabb34ca-260d-4456-bf8c-d75134c8feb6"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:43:00.988747 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-bc1e8010-9da0-4f72-a0ff-2fa7336096e7 req-3bf478f6-c963-4222-a92e-44086cf467c3 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:43:00.989198 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-bc1e8010-9da0-4f72-a0ff-2fa7336096e7 req-3bf478f6-c963-4222-a92e-44086cf467c3 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:43:01.003047 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-bc1e8010-9da0-4f72-a0ff-2fa7336096e7 req-3bf478f6-c963-4222-a92e-44086cf467c3 service nova] Creating event network-changed:dabb34ca-260d-4456-bf8c-d75134c8feb6 for instance ed659e94-1255-44d1-9f29-3acf52af9a8b on hv-cinder-84372 May 28 17:43:01.008084 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-bc1e8010-9da0-4f72-a0ff-2fa7336096e7 req-3bf478f6-c963-4222-a92e-44086cf467c3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169813 May 28 17:43:01.008672 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 626/1250] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:43:01.732420 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8d223665-6ce0-4fe2-9e5d-c7b70935a660 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:43:01.733040 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8d223665-6ce0-4fe2-9e5d-c7b70935a660 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: ed659e94-1255-44d1-9f29-3acf52af9a8b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:43:01.739636 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8d223665-6ce0-4fe2-9e5d-c7b70935a660 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:43:01.740088 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8d223665-6ce0-4fe2-9e5d-c7b70935a660 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:43:01.740848 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8d223665-6ce0-4fe2-9e5d-c7b70935a660 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:43:01.741286 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8d223665-6ce0-4fe2-9e5d-c7b70935a660 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:43:01.868796 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8d223665-6ce0-4fe2-9e5d-c7b70935a660 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:43:01.877127 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8d223665-6ce0-4fe2-9e5d-c7b70935a660 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b" status: 200 len: 1267 microversion: 2.1 time: 0.148304 May 28 17:43:01.877689 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 625/1251] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:43:01 2022] GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:43:02.894882 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-2fca48e5-1654-409f-b6b1-96917755d7f8 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:43:02.895524 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-2fca48e5-1654-409f-b6b1-96917755d7f8 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: ed659e94-1255-44d1-9f29-3acf52af9a8b] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:43:02.901721 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2fca48e5-1654-409f-b6b1-96917755d7f8 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:43:02.902169 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2fca48e5-1654-409f-b6b1-96917755d7f8 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:43:02.902923 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2fca48e5-1654-409f-b6b1-96917755d7f8 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:43:02.903565 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-2fca48e5-1654-409f-b6b1-96917755d7f8 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:43:03.032102 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-2fca48e5-1654-409f-b6b1-96917755d7f8 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:43:03.039529 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-2fca48e5-1654-409f-b6b1-96917755d7f8 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b" status: 200 len: 1267 microversion: 2.1 time: 0.149502 May 28 17:43:03.040085 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 627/1252] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:43:02 2022] GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:43:04.056134 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-98e6fe6f-a25e-4191-ad5f-2649b0786c56 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:43:04.056756 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-98e6fe6f-a25e-4191-ad5f-2649b0786c56 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: ed659e94-1255-44d1-9f29-3acf52af9a8b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:43:04.063638 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-98e6fe6f-a25e-4191-ad5f-2649b0786c56 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:43:04.064094 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-98e6fe6f-a25e-4191-ad5f-2649b0786c56 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:43:04.064863 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-98e6fe6f-a25e-4191-ad5f-2649b0786c56 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:43:04.065308 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-98e6fe6f-a25e-4191-ad5f-2649b0786c56 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:43:04.198575 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-98e6fe6f-a25e-4191-ad5f-2649b0786c56 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:43:04.207663 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-98e6fe6f-a25e-4191-ad5f-2649b0786c56 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b" status: 200 len: 1267 microversion: 2.1 time: 0.155441 May 28 17:43:04.215172 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 626/1253] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:43:04 2022] GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:43:05.225193 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-d292fe07-6759-4603-a5d2-8e7234f7cfa8 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:43:05.225804 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-d292fe07-6759-4603-a5d2-8e7234f7cfa8 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: ed659e94-1255-44d1-9f29-3acf52af9a8b] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:43:05.232277 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d292fe07-6759-4603-a5d2-8e7234f7cfa8 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:43:05.232720 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d292fe07-6759-4603-a5d2-8e7234f7cfa8 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:43:05.233474 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d292fe07-6759-4603-a5d2-8e7234f7cfa8 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:43:05.233902 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-d292fe07-6759-4603-a5d2-8e7234f7cfa8 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:43:05.367325 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-d292fe07-6759-4603-a5d2-8e7234f7cfa8 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:43:05.374764 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-d292fe07-6759-4603-a5d2-8e7234f7cfa8 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b" status: 200 len: 1267 microversion: 2.1 time: 0.153391 May 28 17:43:05.376318 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 628/1254] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:43:05 2022] GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:43:06.392912 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-cbf0b3a5-5e78-470b-963c-83bbff840078 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:43:06.393549 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-cbf0b3a5-5e78-470b-963c-83bbff840078 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: ed659e94-1255-44d1-9f29-3acf52af9a8b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:43:06.399998 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cbf0b3a5-5e78-470b-963c-83bbff840078 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:43:06.400438 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cbf0b3a5-5e78-470b-963c-83bbff840078 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:43:06.401192 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cbf0b3a5-5e78-470b-963c-83bbff840078 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:43:06.401622 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-cbf0b3a5-5e78-470b-963c-83bbff840078 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:43:06.540983 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-cbf0b3a5-5e78-470b-963c-83bbff840078 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:43:06.550979 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-cbf0b3a5-5e78-470b-963c-83bbff840078 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b" status: 200 len: 1267 microversion: 2.1 time: 0.162480 May 28 17:43:06.551593 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 627/1255] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:43:06 2022] GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:43:07.569145 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-fa190340-e7ff-4ca0-ab92-c4bfdace5867 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:43:07.569756 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-fa190340-e7ff-4ca0-ab92-c4bfdace5867 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: ed659e94-1255-44d1-9f29-3acf52af9a8b] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:43:07.576156 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fa190340-e7ff-4ca0-ab92-c4bfdace5867 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:43:07.576603 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fa190340-e7ff-4ca0-ab92-c4bfdace5867 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:43:07.577351 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fa190340-e7ff-4ca0-ab92-c4bfdace5867 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:43:07.577781 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fa190340-e7ff-4ca0-ab92-c4bfdace5867 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:43:07.706093 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-fa190340-e7ff-4ca0-ab92-c4bfdace5867 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:43:07.713690 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-fa190340-e7ff-4ca0-ab92-c4bfdace5867 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b" status: 200 len: 1267 microversion: 2.1 time: 0.148331 May 28 17:43:07.714285 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 629/1256] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:43:07 2022] GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:43:08.731461 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-8d6875b2-2c68-48db-b31e-70309a46a4b4 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:43:08.732107 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-8d6875b2-2c68-48db-b31e-70309a46a4b4 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: ed659e94-1255-44d1-9f29-3acf52af9a8b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:43:08.735092 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell0:SELECT=2 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:43:08.740758 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8d6875b2-2c68-48db-b31e-70309a46a4b4 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:43:08.741217 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8d6875b2-2c68-48db-b31e-70309a46a4b4 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:43:08.741987 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8d6875b2-2c68-48db-b31e-70309a46a4b4 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:43:08.742426 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-8d6875b2-2c68-48db-b31e-70309a46a4b4 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:43:08.867822 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-8d6875b2-2c68-48db-b31e-70309a46a4b4 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:43:08.875354 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-8d6875b2-2c68-48db-b31e-70309a46a4b4 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b" status: 200 len: 1267 microversion: 2.1 time: 0.147737 May 28 17:43:08.875923 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 628/1257] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:43:08 2022] GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:43:09.896090 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-c6f450d8-e9d8-49d1-a415-be9cc82a4508 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:43:09.896731 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-c6f450d8-e9d8-49d1-a415-be9cc82a4508 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: ed659e94-1255-44d1-9f29-3acf52af9a8b] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:43:09.898663 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=2 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:43:09.899488 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell0:SELECT=6 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:43:09.905667 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c6f450d8-e9d8-49d1-a415-be9cc82a4508 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:43:09.906246 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c6f450d8-e9d8-49d1-a415-be9cc82a4508 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:43:09.907363 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c6f450d8-e9d8-49d1-a415-be9cc82a4508 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:43:09.907797 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-c6f450d8-e9d8-49d1-a415-be9cc82a4508 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:43:10.041014 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-c6f450d8-e9d8-49d1-a415-be9cc82a4508 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:43:10.066774 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-c6f450d8-e9d8-49d1-a415-be9cc82a4508 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b" status: 200 len: 1267 microversion: 2.1 time: 0.174258 May 28 17:43:10.067159 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 630/1258] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:43:09 2022] GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:43:11.085310 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-e51bd6df-a97b-41c7-be44-72fa47023faf tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:43:11.085889 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-e51bd6df-a97b-41c7-be44-72fa47023faf tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: ed659e94-1255-44d1-9f29-3acf52af9a8b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:43:11.092506 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e51bd6df-a97b-41c7-be44-72fa47023faf tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:43:11.092980 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e51bd6df-a97b-41c7-be44-72fa47023faf tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:43:11.093815 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e51bd6df-a97b-41c7-be44-72fa47023faf tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:43:11.094256 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-e51bd6df-a97b-41c7-be44-72fa47023faf tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:43:11.225996 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-e51bd6df-a97b-41c7-be44-72fa47023faf tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:43:11.233423 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-e51bd6df-a97b-41c7-be44-72fa47023faf tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b" status: 200 len: 1267 microversion: 2.1 time: 0.152123 May 28 17:43:11.233989 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 629/1259] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:43:11 2022] GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:43:11.407938 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-9027c0ca-0759-4ff0-ae24-9eb14c9ae8dc req-1fb2caee-226b-4eb3-897e-f0a8efc2913c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed659e94-1255-44d1-9f29-3acf52af9a8b", "name": "network-vif-plugged", "status": "completed", "tag": "dabb34ca-260d-4456-bf8c-d75134c8feb6"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:43:11.416245 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-9027c0ca-0759-4ff0-ae24-9eb14c9ae8dc req-1fb2caee-226b-4eb3-897e-f0a8efc2913c service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:43:11.416696 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-9027c0ca-0759-4ff0-ae24-9eb14c9ae8dc req-1fb2caee-226b-4eb3-897e-f0a8efc2913c service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:43:11.428899 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-9027c0ca-0759-4ff0-ae24-9eb14c9ae8dc req-1fb2caee-226b-4eb3-897e-f0a8efc2913c service nova] Creating event network-vif-plugged:dabb34ca-260d-4456-bf8c-d75134c8feb6 for instance ed659e94-1255-44d1-9f29-3acf52af9a8b on hv-cinder-84372 May 28 17:43:11.433833 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-9027c0ca-0759-4ff0-ae24-9eb14c9ae8dc req-1fb2caee-226b-4eb3-897e-f0a8efc2913c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088654 May 28 17:43:11.434494 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 631/1260] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:43:12.254495 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-39ca85d0-bcd3-459d-abb8-e5db23006189 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:43:12.255163 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-39ca85d0-bcd3-459d-abb8-e5db23006189 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: ed659e94-1255-44d1-9f29-3acf52af9a8b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:43:12.261673 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-39ca85d0-bcd3-459d-abb8-e5db23006189 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:43:12.262117 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-39ca85d0-bcd3-459d-abb8-e5db23006189 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:43:12.262869 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-39ca85d0-bcd3-459d-abb8-e5db23006189 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:43:12.263303 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-39ca85d0-bcd3-459d-abb8-e5db23006189 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:43:12.403583 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-39ca85d0-bcd3-459d-abb8-e5db23006189 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:43:12.411283 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-39ca85d0-bcd3-459d-abb8-e5db23006189 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b" status: 200 len: 1267 microversion: 2.1 time: 0.164430 May 28 17:43:12.411869 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 630/1261] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:43:12 2022] GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:43:13.429759 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-fad2121e-39d3-4ca8-a2f8-8d8a5b5c49a5 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:43:13.430469 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-fad2121e-39d3-4ca8-a2f8-8d8a5b5c49a5 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: ed659e94-1255-44d1-9f29-3acf52af9a8b] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:43:13.436990 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fad2121e-39d3-4ca8-a2f8-8d8a5b5c49a5 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:43:13.438103 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fad2121e-39d3-4ca8-a2f8-8d8a5b5c49a5 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:43:13.439363 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fad2121e-39d3-4ca8-a2f8-8d8a5b5c49a5 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:43:13.440239 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-fad2121e-39d3-4ca8-a2f8-8d8a5b5c49a5 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:43:13.582809 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-fad2121e-39d3-4ca8-a2f8-8d8a5b5c49a5 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:43:13.594283 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-fad2121e-39d3-4ca8-a2f8-8d8a5b5c49a5 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b" status: 200 len: 1455 microversion: 2.1 time: 0.168895 May 28 17:43:13.595100 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 632/1262] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:43:13 2022] GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b => generated 1455 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:43:13.612918 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-d7672857-fa5f-4a76-841c-cd2b4cb0fdd0 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:43:13.613656 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-d7672857-fa5f-4a76-841c-cd2b4cb0fdd0 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: ed659e94-1255-44d1-9f29-3acf52af9a8b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:43:13.620679 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d7672857-fa5f-4a76-841c-cd2b4cb0fdd0 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:43:13.621133 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d7672857-fa5f-4a76-841c-cd2b4cb0fdd0 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:43:13.621911 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d7672857-fa5f-4a76-841c-cd2b4cb0fdd0 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:43:13.622358 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-d7672857-fa5f-4a76-841c-cd2b4cb0fdd0 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:43:13.758201 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-d7672857-fa5f-4a76-841c-cd2b4cb0fdd0 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:43:13.766562 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-d7672857-fa5f-4a76-841c-cd2b4cb0fdd0 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b" status: 200 len: 1455 microversion: 2.1 time: 0.158563 May 28 17:43:13.767131 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 631/1263] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:43:13 2022] GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b => generated 1455 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:43:15.750974 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-36efa326-7f61-4c6b-8fbb-01dd973399ec req-8f1d1d00-5930-4d22-90f6-7af38ab5e27e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed659e94-1255-44d1-9f29-3acf52af9a8b", "tag": "dabb34ca-260d-4456-bf8c-d75134c8feb6"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:43:15.759632 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-36efa326-7f61-4c6b-8fbb-01dd973399ec req-8f1d1d00-5930-4d22-90f6-7af38ab5e27e service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:43:15.760073 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-36efa326-7f61-4c6b-8fbb-01dd973399ec req-8f1d1d00-5930-4d22-90f6-7af38ab5e27e service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:43:15.772137 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-36efa326-7f61-4c6b-8fbb-01dd973399ec req-8f1d1d00-5930-4d22-90f6-7af38ab5e27e service nova] Creating event network-changed:dabb34ca-260d-4456-bf8c-d75134c8feb6 for instance ed659e94-1255-44d1-9f29-3acf52af9a8b on hv-cinder-84372 May 28 17:43:15.777182 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-36efa326-7f61-4c6b-8fbb-01dd973399ec req-8f1d1d00-5930-4d22-90f6-7af38ab5e27e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030282 May 28 17:43:15.777953 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 633/1264] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:43:57.176635 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 17:43:57.177252 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Sat May 28 17:43:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 17:44:12.154014 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 17:44:12.154729 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Sat May 28 17:44:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 17:45:05.571360 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_api:SELECT=20 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:45:05.572744 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG dbcounter [-] [117605] Writing DB stats nova_cell1:SELECT=48 {{(pid=117605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:45:05.573784 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:45:05.574477 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG dbcounter [-] [117604] Writing DB stats nova_cell1:SELECT=44 {{(pid=117604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 17:45:05.577289 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-c73d0db4-7309-4af7-83d3-bc054e93154a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:45:05.577966 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c73d0db4-7309-4af7-83d3-bc054e93154a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: ed659e94-1255-44d1-9f29-3acf52af9a8b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:45:05.585934 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c73d0db4-7309-4af7-83d3-bc054e93154a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:45:05.586384 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c73d0db4-7309-4af7-83d3-bc054e93154a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:45:05.587747 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c73d0db4-7309-4af7-83d3-bc054e93154a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:45:05.587747 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-c73d0db4-7309-4af7-83d3-bc054e93154a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:45:05.615274 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-c73d0db4-7309-4af7-83d3-bc054e93154a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: ed659e94-1255-44d1-9f29-3acf52af9a8b] Going to try to terminate instance {{(pid=117605) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 17:45:05.638123 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-fd1efb61-6fee-43b9-a66b-a40d8e08a46d req-86ed1077-88fd-404b-8187-2d08a74756c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed659e94-1255-44d1-9f29-3acf52af9a8b", "tag": "dabb34ca-260d-4456-bf8c-d75134c8feb6"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:45:05.646289 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-fd1efb61-6fee-43b9-a66b-a40d8e08a46d req-86ed1077-88fd-404b-8187-2d08a74756c5 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:45:05.646822 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-fd1efb61-6fee-43b9-a66b-a40d8e08a46d req-86ed1077-88fd-404b-8187-2d08a74756c5 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:45:05.658185 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-fd1efb61-6fee-43b9-a66b-a40d8e08a46d req-86ed1077-88fd-404b-8187-2d08a74756c5 service nova] Creating event network-changed:dabb34ca-260d-4456-bf8c-d75134c8feb6 for instance ed659e94-1255-44d1-9f29-3acf52af9a8b on hv-cinder-84372 May 28 17:45:05.663963 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-fd1efb61-6fee-43b9-a66b-a40d8e08a46d req-86ed1077-88fd-404b-8187-2d08a74756c5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092117 May 28 17:45:05.665054 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 634/1265] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:45:05.697329 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-c73d0db4-7309-4af7-83d3-bc054e93154a tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b" status: 204 len: 0 microversion: 2.1 time: 0.127062 May 28 17:45:05.702507 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 632/1266] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 17:45:05 2022] DELETE /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 17:45:05.708464 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f03edf60-cca6-4f36-9c86-26d4053b3f6c tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:45:05.709168 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f03edf60-cca6-4f36-9c86-26d4053b3f6c tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: ed659e94-1255-44d1-9f29-3acf52af9a8b] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:45:05.716697 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f03edf60-cca6-4f36-9c86-26d4053b3f6c tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:45:05.717487 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f03edf60-cca6-4f36-9c86-26d4053b3f6c tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:45:05.718518 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f03edf60-cca6-4f36-9c86-26d4053b3f6c tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:45:05.719150 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f03edf60-cca6-4f36-9c86-26d4053b3f6c tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:45:05.862338 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-f03edf60-cca6-4f36-9c86-26d4053b3f6c tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:45:05.870056 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f03edf60-cca6-4f36-9c86-26d4053b3f6c tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b" status: 200 len: 1580 microversion: 2.1 time: 0.166015 May 28 17:45:05.870787 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 635/1267] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:45:05 2022] GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b => generated 1580 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:45:06.888267 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-9a36e831-a7b4-4b8a-9fd4-07e5028a88e3 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:45:06.888969 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-9a36e831-a7b4-4b8a-9fd4-07e5028a88e3 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: ed659e94-1255-44d1-9f29-3acf52af9a8b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:45:06.896064 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9a36e831-a7b4-4b8a-9fd4-07e5028a88e3 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:45:06.896515 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9a36e831-a7b4-4b8a-9fd4-07e5028a88e3 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:45:06.897281 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9a36e831-a7b4-4b8a-9fd4-07e5028a88e3 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:45:06.897716 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-9a36e831-a7b4-4b8a-9fd4-07e5028a88e3 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:45:07.063874 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-9a36e831-a7b4-4b8a-9fd4-07e5028a88e3 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:45:07.072064 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-9a36e831-a7b4-4b8a-9fd4-07e5028a88e3 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b" status: 200 len: 1580 microversion: 2.1 time: 0.188093 May 28 17:45:07.072627 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 633/1268] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:45:06 2022] GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b => generated 1580 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:45:07.996257 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-eb053c9c-bc30-4d5c-996a-34fc30be7f92 req-fc04b978-4db9-4e52-ad6c-cef7ea6e9eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed659e94-1255-44d1-9f29-3acf52af9a8b", "name": "network-vif-deleted", "tag": "dabb34ca-260d-4456-bf8c-d75134c8feb6"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:45:08.006893 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-eb053c9c-bc30-4d5c-996a-34fc30be7f92 req-fc04b978-4db9-4e52-ad6c-cef7ea6e9eb3 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:45:08.007331 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-eb053c9c-bc30-4d5c-996a-34fc30be7f92 req-fc04b978-4db9-4e52-ad6c-cef7ea6e9eb3 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:45:08.021160 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-eb053c9c-bc30-4d5c-996a-34fc30be7f92 req-fc04b978-4db9-4e52-ad6c-cef7ea6e9eb3 service nova] Creating event network-vif-deleted:dabb34ca-260d-4456-bf8c-d75134c8feb6 for instance ed659e94-1255-44d1-9f29-3acf52af9a8b on hv-cinder-84372 May 28 17:45:08.026237 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-eb053c9c-bc30-4d5c-996a-34fc30be7f92 req-fc04b978-4db9-4e52-ad6c-cef7ea6e9eb3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033622 May 28 17:45:08.026837 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 636/1269] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:45:08.089843 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-dcbd2ab4-6284-4980-ada1-798dfa14b7ad tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:45:08.090453 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-dcbd2ab4-6284-4980-ada1-798dfa14b7ad tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: ed659e94-1255-44d1-9f29-3acf52af9a8b] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:45:08.096768 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dcbd2ab4-6284-4980-ada1-798dfa14b7ad tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:45:08.097214 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dcbd2ab4-6284-4980-ada1-798dfa14b7ad tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:45:08.097971 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dcbd2ab4-6284-4980-ada1-798dfa14b7ad tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:45:08.098399 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-dcbd2ab4-6284-4980-ada1-798dfa14b7ad tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:45:08.161903 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-dcbd2ab4-6284-4980-ada1-798dfa14b7ad tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:45:08.169308 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-dcbd2ab4-6284-4980-ada1-798dfa14b7ad tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b" status: 200 len: 1226 microversion: 2.1 time: 0.083254 May 28 17:45:08.169861 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 634/1270] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:45:08 2022] GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:45:09.187444 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f4c8dd32-a2b4-42fb-be25-2430f3763c37 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:45:09.188137 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f4c8dd32-a2b4-42fb-be25-2430f3763c37 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: ed659e94-1255-44d1-9f29-3acf52af9a8b] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:45:09.194936 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f4c8dd32-a2b4-42fb-be25-2430f3763c37 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:45:09.195401 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f4c8dd32-a2b4-42fb-be25-2430f3763c37 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:45:09.196150 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f4c8dd32-a2b4-42fb-be25-2430f3763c37 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:45:09.196583 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f4c8dd32-a2b4-42fb-be25-2430f3763c37 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:45:09.210110 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-f4c8dd32-a2b4-42fb-be25-2430f3763c37 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] HTTP exception thrown: Instance ed659e94-1255-44d1-9f29-3acf52af9a8b could not be found. May 28 17:45:09.211742 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f4c8dd32-a2b4-42fb-be25-2430f3763c37 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Request method failure captured: May 28 17:45:09.211742 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b HTTP/1.1 May 28 17:45:09.211742 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:45:09.211742 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:45:09.211742 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:45:09.211742 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 0 May 28 17:45:09.211742 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:45:09.211742 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:45:09.211742 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:45:09.211742 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:45:09.211742 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABikl2sVHxHq3Z4FGL7IPua6hCg_iOssqnObQf3QnEjNK0lGhbyZ8NkV55Krc4LDl7izrmdukgf7T8-EN3nhz-JVqxugBxZcp1WHvcPMoqVhkZLOGsjsAqx9z2ozPFsVJR-1-Dl7ci5MVG7-OchToZXa8Ie-Z18Y6dRprxI9GMrLNTiZO4 May 28 17:45:09.211742 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:45:09.211742 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:45:09.211742 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:45:09.211742 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:45:09.211742 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:45:09.211742 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:45:09.211742 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: 3785f78e6d1048cfa0b5b123fdd909c8 May 28 17:45:09.211742 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-TestVolumeBootPattern-1713257441 May 28 17:45:09.211742 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:45:09.211742 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:45:09.213594 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3785f78e6d1048cfa0b5b123fdd909c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3785f78e6d1048cfa0b5b123fdd909c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3785f78e6d1048cfa0b5b123fdd909c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3785f78e6d1048cfa0b5b123fdd909c8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:45:09.213594 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-TestVolumeBootPattern-1713257441 May 28 17:45:09.213594 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 3785f78e6d1048cfa0b5b123fdd909c8 May 28 17:45:09.213594 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-TestVolumeBootPattern-1713257441 May 28 17:45:09.213594 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-TestVolumeBootPattern-1713257441-project May 28 17:45:09.213594 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:45:09.213594 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:45:09.213594 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: 4a827bedc4b84508bb7770a09efee3f5 May 28 17:45:09.213594 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-TestVolumeBootPattern-1713257441-project May 28 17:45:09.213594 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: > May 28 17:45:09.213594 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Instance ed659e94-1255-44d1-9f29-3acf52af9a8b could not be found. May 28 17:45:09.213594 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'id': 'ed659e94-1255-44d1-9f29-3acf52af9a8b'} May 28 17:45:09.214619 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:45:09.214619 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:45:09.214619 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:45:09.214619 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:45:09.214619 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:45:09.214619 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:45:09.214619 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:45:09.214619 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:45:09.214619 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:45:09.214619 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:45:09.214619 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed659e94-1255-44d1-9f29-3acf52af9a8b could not be found. May 28 17:45:09.214619 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:45:09.214619 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:45:09.214619 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:45:09.214619 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:45:09.214619 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:45:09.214619 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:45:09.214619 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:45:09.214619 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:45:09.214619 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:45:09.216448 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:45:09.216448 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:45:09.216448 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:45:09.216448 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:45:09.216448 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:45:09.216448 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:45:09.216448 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:45:09.216448 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed659e94-1255-44d1-9f29-3acf52af9a8b could not be found. May 28 17:45:09.216448 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:45:09.216448 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:45:09.216448 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:45:09.216448 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:45:09.216448 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:45:09.216448 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:45:09.216448 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:45:09.216448 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:45:09.216448 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed659e94-1255-44d1-9f29-3acf52af9a8b could not be found. May 28 17:45:09.216448 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:45:09.217953 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f4c8dd32-a2b4-42fb-be25-2430f3763c37 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Returning 404 to user: Instance ed659e94-1255-44d1-9f29-3acf52af9a8b could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:45:09.217953 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f4c8dd32-a2b4-42fb-be25-2430f3763c37 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b" status: 404 len: 111 microversion: 2.1 time: 0.030273 May 28 17:45:09.217953 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 637/1271] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:45:09 2022] GET /compute/v2.1/servers/ed659e94-1255-44d1-9f29-3acf52af9a8b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:45:12.260397 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-94a69325-53f5-4c12-a688-02700bb25b88 req-cde96c0f-71ec-41af-90b9-0749021adc48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55b6f098-3687-4ce1-a74a-2e050591eddd", "tag": "5c34b26f-cf27-4dcb-bde9-01d75bac0901"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:45:12.263831 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-58601424-8022-42f1-8f5e-de1836280cfb tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:45:12.264408 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-58601424-8022-42f1-8f5e-de1836280cfb tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 55b6f098-3687-4ce1-a74a-2e050591eddd] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:45:12.271789 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-58601424-8022-42f1-8f5e-de1836280cfb tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:45:12.272259 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-58601424-8022-42f1-8f5e-de1836280cfb tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:45:12.273149 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-58601424-8022-42f1-8f5e-de1836280cfb tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:45:12.273600 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-58601424-8022-42f1-8f5e-de1836280cfb tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:45:12.276980 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-94a69325-53f5-4c12-a688-02700bb25b88 req-cde96c0f-71ec-41af-90b9-0749021adc48 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:45:12.277425 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-94a69325-53f5-4c12-a688-02700bb25b88 req-cde96c0f-71ec-41af-90b9-0749021adc48 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:45:12.288868 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-94a69325-53f5-4c12-a688-02700bb25b88 req-cde96c0f-71ec-41af-90b9-0749021adc48 service nova] Creating event network-changed:5c34b26f-cf27-4dcb-bde9-01d75bac0901 for instance 55b6f098-3687-4ce1-a74a-2e050591eddd on hv-cinder-84372 May 28 17:45:12.295191 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-94a69325-53f5-4c12-a688-02700bb25b88 req-cde96c0f-71ec-41af-90b9-0749021adc48 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037487 May 28 17:45:12.295191 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 638/1272] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:45:12.302203 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-58601424-8022-42f1-8f5e-de1836280cfb tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 55b6f098-3687-4ce1-a74a-2e050591eddd] Going to try to terminate instance {{(pid=117605) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 17:45:12.388875 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-58601424-8022-42f1-8f5e-de1836280cfb tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "DELETE /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd" status: 204 len: 0 microversion: 2.1 time: 0.135164 May 28 17:45:12.389762 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 635/1273] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 17:45:12 2022] DELETE /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 17:45:12.398865 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-884e3617-1dc8-4ab0-93b6-c0af7c0abf79 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:45:12.399946 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-884e3617-1dc8-4ab0-93b6-c0af7c0abf79 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 55b6f098-3687-4ce1-a74a-2e050591eddd] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:45:12.406131 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-884e3617-1dc8-4ab0-93b6-c0af7c0abf79 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:45:12.406575 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-884e3617-1dc8-4ab0-93b6-c0af7c0abf79 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:45:12.407385 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-884e3617-1dc8-4ab0-93b6-c0af7c0abf79 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:45:12.407819 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-884e3617-1dc8-4ab0-93b6-c0af7c0abf79 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:45:12.550696 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.policy [None req-884e3617-1dc8-4ab0-93b6-c0af7c0abf79 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117604) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:45:12.559073 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-884e3617-1dc8-4ab0-93b6-c0af7c0abf79 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd" status: 200 len: 1579 microversion: 2.1 time: 0.165043 May 28 17:45:12.559690 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 639/1274] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:45:12 2022] GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd => generated 1579 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:45:13.577344 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-1a2508c2-6397-4dfb-9003-7085a473bf1b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:45:13.577965 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-1a2508c2-6397-4dfb-9003-7085a473bf1b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 55b6f098-3687-4ce1-a74a-2e050591eddd] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:45:13.585280 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1a2508c2-6397-4dfb-9003-7085a473bf1b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:45:13.585724 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1a2508c2-6397-4dfb-9003-7085a473bf1b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:45:13.586484 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1a2508c2-6397-4dfb-9003-7085a473bf1b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:45:13.586916 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-1a2508c2-6397-4dfb-9003-7085a473bf1b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:45:13.764899 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-1a2508c2-6397-4dfb-9003-7085a473bf1b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:45:13.773102 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-1a2508c2-6397-4dfb-9003-7085a473bf1b tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd" status: 200 len: 1579 microversion: 2.1 time: 0.200043 May 28 17:45:13.773664 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 636/1275] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:45:13 2022] GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd => generated 1579 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:45:14.609863 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [req-025e4e49-2028-431d-9327-4417eba33ea9 req-438a8c8c-30a6-4b11-86d2-f3fe41408ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55b6f098-3687-4ce1-a74a-2e050591eddd", "name": "network-vif-deleted", "tag": "5c34b26f-cf27-4dcb-bde9-01d75bac0901"}]} {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 17:45:14.618589 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-025e4e49-2028-431d-9327-4417eba33ea9 req-438a8c8c-30a6-4b11-86d2-f3fe41408ea7 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:45:14.619031 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [req-025e4e49-2028-431d-9327-4417eba33ea9 req-438a8c8c-30a6-4b11-86d2-f3fe41408ea7 service nova] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:45:14.630715 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.compute.server_external_events [req-025e4e49-2028-431d-9327-4417eba33ea9 req-438a8c8c-30a6-4b11-86d2-f3fe41408ea7 service nova] Creating event network-vif-deleted:5c34b26f-cf27-4dcb-bde9-01d75bac0901 for instance 55b6f098-3687-4ce1-a74a-2e050591eddd on hv-cinder-84372 May 28 17:45:14.636538 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [req-025e4e49-2028-431d-9327-4417eba33ea9 req-438a8c8c-30a6-4b11-86d2-f3fe41408ea7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030167 May 28 17:45:14.637176 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 640/1276] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 17:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 17:45:14.790815 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-2f7b6c4d-6924-4d8b-b563-b6006e1b2c2f tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:45:14.791611 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-2f7b6c4d-6924-4d8b-b563-b6006e1b2c2f tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 55b6f098-3687-4ce1-a74a-2e050591eddd] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:45:14.798813 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2f7b6c4d-6924-4d8b-b563-b6006e1b2c2f tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:45:14.799630 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2f7b6c4d-6924-4d8b-b563-b6006e1b2c2f tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:45:14.800959 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2f7b6c4d-6924-4d8b-b563-b6006e1b2c2f tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:45:14.801740 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-2f7b6c4d-6924-4d8b-b563-b6006e1b2c2f tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:45:14.867584 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.policy [None req-2f7b6c4d-6924-4d8b-b563-b6006e1b2c2f tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a827bedc4b84508bb7770a09efee3f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3785f78e6d1048cfa0b5b123fdd909c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117605) authorize /opt/stack/nova/nova/policy.py:199}} May 28 17:45:14.875569 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-2f7b6c4d-6924-4d8b-b563-b6006e1b2c2f tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd" status: 200 len: 1226 microversion: 2.1 time: 0.089058 May 28 17:45:14.876501 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 637/1277] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:45:14 2022] GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 17:45:15.895858 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f60e6b37-7a28-4d7d-ba92-9afbd1f1eb52 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:45:15.896481 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-f60e6b37-7a28-4d7d-ba92-9afbd1f1eb52 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 55b6f098-3687-4ce1-a74a-2e050591eddd] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:45:15.903025 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f60e6b37-7a28-4d7d-ba92-9afbd1f1eb52 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:45:15.903850 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f60e6b37-7a28-4d7d-ba92-9afbd1f1eb52 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:45:15.904724 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f60e6b37-7a28-4d7d-ba92-9afbd1f1eb52 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:45:15.905164 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-f60e6b37-7a28-4d7d-ba92-9afbd1f1eb52 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:45:15.919254 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-f60e6b37-7a28-4d7d-ba92-9afbd1f1eb52 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] HTTP exception thrown: Instance 55b6f098-3687-4ce1-a74a-2e050591eddd could not be found. May 28 17:45:15.920914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f60e6b37-7a28-4d7d-ba92-9afbd1f1eb52 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Request method failure captured: May 28 17:45:15.920914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd HTTP/1.1 May 28 17:45:15.920914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:45:15.920914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:45:15.920914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:45:15.920914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 0 May 28 17:45:15.920914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:45:15.920914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:45:15.920914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:45:15.920914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:45:15.920914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABikl2sVHxHq3Z4FGL7IPua6hCg_iOssqnObQf3QnEjNK0lGhbyZ8NkV55Krc4LDl7izrmdukgf7T8-EN3nhz-JVqxugBxZcp1WHvcPMoqVhkZLOGsjsAqx9z2ozPFsVJR-1-Dl7ci5MVG7-OchToZXa8Ie-Z18Y6dRprxI9GMrLNTiZO4 May 28 17:45:15.920914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:45:15.920914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:45:15.920914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:45:15.920914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:45:15.920914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:45:15.920914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:45:15.920914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: 3785f78e6d1048cfa0b5b123fdd909c8 May 28 17:45:15.920914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-TestVolumeBootPattern-1713257441 May 28 17:45:15.920914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:45:15.920914 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:45:15.922750 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3785f78e6d1048cfa0b5b123fdd909c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3785f78e6d1048cfa0b5b123fdd909c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3785f78e6d1048cfa0b5b123fdd909c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3785f78e6d1048cfa0b5b123fdd909c8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:45:15.922750 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-TestVolumeBootPattern-1713257441 May 28 17:45:15.922750 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 3785f78e6d1048cfa0b5b123fdd909c8 May 28 17:45:15.922750 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-TestVolumeBootPattern-1713257441 May 28 17:45:15.922750 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-TestVolumeBootPattern-1713257441-project May 28 17:45:15.922750 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:45:15.922750 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:45:15.922750 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: 4a827bedc4b84508bb7770a09efee3f5 May 28 17:45:15.922750 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-TestVolumeBootPattern-1713257441-project May 28 17:45:15.922750 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: > May 28 17:45:15.922750 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Instance 55b6f098-3687-4ce1-a74a-2e050591eddd could not be found. May 28 17:45:15.922750 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'id': '55b6f098-3687-4ce1-a74a-2e050591eddd'} May 28 17:45:15.923652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:45:15.923652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:45:15.923652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:45:15.923652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:45:15.923652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:45:15.923652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:45:15.923652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:45:15.923652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:45:15.923652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:45:15.923652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:45:15.923652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55b6f098-3687-4ce1-a74a-2e050591eddd could not be found. May 28 17:45:15.923652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:45:15.923652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:45:15.923652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:45:15.923652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:45:15.923652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:45:15.923652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:45:15.923652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:45:15.923652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:45:15.923652 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:45:15.925560 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:45:15.925560 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:45:15.925560 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:45:15.925560 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:45:15.925560 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:45:15.925560 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:45:15.925560 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:45:15.925560 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55b6f098-3687-4ce1-a74a-2e050591eddd could not be found. May 28 17:45:15.925560 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:45:15.925560 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:45:15.925560 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:45:15.925560 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:45:15.925560 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:45:15.925560 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:45:15.925560 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:45:15.925560 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:45:15.925560 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55b6f098-3687-4ce1-a74a-2e050591eddd could not be found. May 28 17:45:15.925560 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:45:15.927730 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-f60e6b37-7a28-4d7d-ba92-9afbd1f1eb52 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Returning 404 to user: Instance 55b6f098-3687-4ce1-a74a-2e050591eddd could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:45:15.927730 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-f60e6b37-7a28-4d7d-ba92-9afbd1f1eb52 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd" status: 404 len: 111 microversion: 2.1 time: 0.031402 May 28 17:45:15.927730 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 641/1278] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:45:15 2022] GET /compute/v2.1/servers/55b6f098-3687-4ce1-a74a-2e050591eddd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:45:16.347990 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7291219e-c35a-4820-b3ff-2a5ad95a3aa0 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:45:16.348523 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.compute.api [None req-7291219e-c35a-4820-b3ff-2a5ad95a3aa0 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117605) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:45:16.355810 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7291219e-c35a-4820-b3ff-2a5ad95a3aa0 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:45:16.356266 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7291219e-c35a-4820-b3ff-2a5ad95a3aa0 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:45:16.357030 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7291219e-c35a-4820-b3ff-2a5ad95a3aa0 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:45:16.357475 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG oslo_concurrency.lockutils [None req-7291219e-c35a-4820-b3ff-2a5ad95a3aa0 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:45:16.370519 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.wsgi [None req-7291219e-c35a-4820-b3ff-2a5ad95a3aa0 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] HTTP exception thrown: Instance 03b782e2-0501-4467-9b07-0a0766795ad4 could not be found. May 28 17:45:16.372183 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7291219e-c35a-4820-b3ff-2a5ad95a3aa0 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Request method failure captured: May 28 17:45:16.372183 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: request: DELETE /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 HTTP/1.1 May 28 17:45:16.372183 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept: application/json May 28 17:45:16.372183 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Accept-Encoding: identity May 28 17:45:16.372183 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Connection: close May 28 17:45:16.372183 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Length: 0 May 28 17:45:16.372183 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Content-Type: application/json May 28 17:45:16.372183 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Host: 10.222.0.33 May 28 17:45:16.372183 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Openstack-System-Scope: None May 28 17:45:16.372183 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: User-Agent: python-urllib3/1.26.9 May 28 17:45:16.372183 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Auth-Token: gAAAAABikl2sVHxHq3Z4FGL7IPua6hCg_iOssqnObQf3QnEjNK0lGhbyZ8NkV55Krc4LDl7izrmdukgf7T8-EN3nhz-JVqxugBxZcp1WHvcPMoqVhkZLOGsjsAqx9z2ozPFsVJR-1-Dl7ci5MVG7-OchToZXa8Ie-Z18Y6dRprxI9GMrLNTiZO4 May 28 17:45:16.372183 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Id: None May 28 17:45:16.372183 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Domain-Name: None May 28 17:45:16.372183 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Identity-Status: Confirmed May 28 17:45:16.372183 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Is-Admin-Project: True May 28 17:45:16.372183 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Id: default May 28 17:45:16.372183 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Domain-Name: Default May 28 17:45:16.372183 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Id: 3785f78e6d1048cfa0b5b123fdd909c8 May 28 17:45:16.372183 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Project-Name: tempest-TestVolumeBootPattern-1713257441 May 28 17:45:16.372183 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Role: reader,member May 28 17:45:16.372183 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Roles: reader,member May 28 17:45:16.374054 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3785f78e6d1048cfa0b5b123fdd909c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3785f78e6d1048cfa0b5b123fdd909c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3785f78e6d1048cfa0b5b123fdd909c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3785f78e6d1048cfa0b5b123fdd909c8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:45:16.374054 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant: tempest-TestVolumeBootPattern-1713257441 May 28 17:45:16.374054 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Id: 3785f78e6d1048cfa0b5b123fdd909c8 May 28 17:45:16.374054 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-Tenant-Name: tempest-TestVolumeBootPattern-1713257441 May 28 17:45:16.374054 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User: tempest-TestVolumeBootPattern-1713257441-project May 28 17:45:16.374054 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Id: default May 28 17:45:16.374054 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Domain-Name: Default May 28 17:45:16.374054 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Id: 4a827bedc4b84508bb7770a09efee3f5 May 28 17:45:16.374054 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: X-User-Name: tempest-TestVolumeBootPattern-1713257441-project May 28 17:45:16.374054 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: method: > May 28 17:45:16.374054 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: exception: Instance 03b782e2-0501-4467-9b07-0a0766795ad4 could not be found. May 28 17:45:16.374054 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: action_args: {'id': '03b782e2-0501-4467-9b07-0a0766795ad4'} May 28 17:45:16.375032 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:45:16.375032 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:45:16.375032 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:45:16.375032 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:45:16.375032 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:45:16.375032 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:45:16.375032 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:45:16.375032 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:45:16.375032 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:45:16.375032 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:45:16.375032 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03b782e2-0501-4467-9b07-0a0766795ad4 could not be found. May 28 17:45:16.375032 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:45:16.375032 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:45:16.375032 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:45:16.375032 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:45:16.375032 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:45:16.375032 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:45:16.375032 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:45:16.375032 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:45:16.375032 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:45:16.376767 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:45:16.376767 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 17:45:16.376767 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 17:45:16.376767 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 17:45:16.376767 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 17:45:16.376767 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:45:16.376767 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:45:16.376767 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:45:16.376767 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:45:16.376767 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03b782e2-0501-4467-9b07-0a0766795ad4 could not be found. May 28 17:45:16.376767 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:45:16.376767 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:45:16.376767 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:45:16.376767 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:45:16.376767 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:45:16.376767 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:45:16.376767 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:45:16.376767 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:45:16.376767 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03b782e2-0501-4467-9b07-0a0766795ad4 could not be found. May 28 17:45:16.376767 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: ERROR nova.api.openstack.wsgi May 28 17:45:16.378673 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-7291219e-c35a-4820-b3ff-2a5ad95a3aa0 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Returning 404 to user: Instance 03b782e2-0501-4467-9b07-0a0766795ad4 could not be found. {{(pid=117605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:45:16.378673 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-7291219e-c35a-4820-b3ff-2a5ad95a3aa0 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "DELETE /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 404 len: 111 microversion: 2.1 time: 0.029419 May 28 17:45:16.378673 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 638/1279] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 17:45:16 2022] DELETE /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:45:16.382409 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e02af0ac-b979-4f16-9b7e-cac84146b962 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '>' {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:45:16.383034 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.compute.api [None req-e02af0ac-b979-4f16-9b7e-cac84146b962 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] [instance: 03b782e2-0501-4467-9b07-0a0766795ad4] Fetching instance by UUID {{(pid=117604) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 17:45:16.389033 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e02af0ac-b979-4f16-9b7e-cac84146b962 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:45:16.389482 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e02af0ac-b979-4f16-9b7e-cac84146b962 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:45:16.390245 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e02af0ac-b979-4f16-9b7e-cac84146b962 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 17:45:16.390684 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG oslo_concurrency.lockutils [None req-e02af0ac-b979-4f16-9b7e-cac84146b962 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Lock "8bcdc320-938f-4056-a651-903bfb22d443" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 17:45:16.404287 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.wsgi [None req-e02af0ac-b979-4f16-9b7e-cac84146b962 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] HTTP exception thrown: Instance 03b782e2-0501-4467-9b07-0a0766795ad4 could not be found. May 28 17:45:16.405782 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e02af0ac-b979-4f16-9b7e-cac84146b962 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Request method failure captured: May 28 17:45:16.405782 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: request: GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 HTTP/1.1 May 28 17:45:16.405782 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept: application/json May 28 17:45:16.405782 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Accept-Encoding: identity May 28 17:45:16.405782 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Connection: close May 28 17:45:16.405782 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Length: 0 May 28 17:45:16.405782 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Content-Type: application/json May 28 17:45:16.405782 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Host: 10.222.0.33 May 28 17:45:16.405782 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Openstack-System-Scope: None May 28 17:45:16.405782 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: User-Agent: python-urllib3/1.26.9 May 28 17:45:16.405782 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Auth-Token: gAAAAABikl2sVHxHq3Z4FGL7IPua6hCg_iOssqnObQf3QnEjNK0lGhbyZ8NkV55Krc4LDl7izrmdukgf7T8-EN3nhz-JVqxugBxZcp1WHvcPMoqVhkZLOGsjsAqx9z2ozPFsVJR-1-Dl7ci5MVG7-OchToZXa8Ie-Z18Y6dRprxI9GMrLNTiZO4 May 28 17:45:16.405782 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Id: None May 28 17:45:16.405782 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Domain-Name: None May 28 17:45:16.405782 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Identity-Status: Confirmed May 28 17:45:16.405782 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Is-Admin-Project: True May 28 17:45:16.405782 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Id: default May 28 17:45:16.405782 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Domain-Name: Default May 28 17:45:16.405782 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Id: 3785f78e6d1048cfa0b5b123fdd909c8 May 28 17:45:16.405782 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Project-Name: tempest-TestVolumeBootPattern-1713257441 May 28 17:45:16.405782 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Role: reader,member May 28 17:45:16.405782 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Roles: reader,member May 28 17:45:16.407581 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3785f78e6d1048cfa0b5b123fdd909c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3785f78e6d1048cfa0b5b123fdd909c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3785f78e6d1048cfa0b5b123fdd909c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3785f78e6d1048cfa0b5b123fdd909c8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] May 28 17:45:16.407581 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant: tempest-TestVolumeBootPattern-1713257441 May 28 17:45:16.407581 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Id: 3785f78e6d1048cfa0b5b123fdd909c8 May 28 17:45:16.407581 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-Tenant-Name: tempest-TestVolumeBootPattern-1713257441 May 28 17:45:16.407581 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User: tempest-TestVolumeBootPattern-1713257441-project May 28 17:45:16.407581 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Id: default May 28 17:45:16.407581 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Domain-Name: Default May 28 17:45:16.407581 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Id: 4a827bedc4b84508bb7770a09efee3f5 May 28 17:45:16.407581 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: X-User-Name: tempest-TestVolumeBootPattern-1713257441-project May 28 17:45:16.407581 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: method: > May 28 17:45:16.407581 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: exception: Instance 03b782e2-0501-4467-9b07-0a0766795ad4 could not be found. May 28 17:45:16.407581 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: action_args: {'id': '03b782e2-0501-4467-9b07-0a0766795ad4'} May 28 17:45:16.408597 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: {{(pid=117604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 17:45:16.408597 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:45:16.408597 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 17:45:16.408597 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 17:45:16.408597 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 17:45:16.408597 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 17:45:16.408597 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 17:45:16.408597 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 17:45:16.408597 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 17:45:16.408597 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 17:45:16.408597 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03b782e2-0501-4467-9b07-0a0766795ad4 could not be found. May 28 17:45:16.408597 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:45:16.408597 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:45:16.408597 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:45:16.408597 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:45:16.408597 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:45:16.408597 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:45:16.408597 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 17:45:16.408597 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 17:45:16.408597 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 17:45:16.410247 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 17:45:16.410247 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 17:45:16.410247 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 17:45:16.410247 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 17:45:16.410247 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 17:45:16.410247 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 17:45:16.410247 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 17:45:16.410247 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03b782e2-0501-4467-9b07-0a0766795ad4 could not be found. May 28 17:45:16.410247 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:45:16.410247 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 17:45:16.410247 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:45:16.410247 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 17:45:16.410247 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 17:45:16.410247 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 17:45:16.410247 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 17:45:16.410247 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 17:45:16.410247 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03b782e2-0501-4467-9b07-0a0766795ad4 could not be found. May 28 17:45:16.410247 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: ERROR nova.api.openstack.wsgi May 28 17:45:16.412373 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: DEBUG nova.api.openstack.wsgi [None req-e02af0ac-b979-4f16-9b7e-cac84146b962 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Returning 404 to user: Instance 03b782e2-0501-4467-9b07-0a0766795ad4 could not be found. {{(pid=117604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 17:45:16.412373 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO nova.api.openstack.requestlog [None req-e02af0ac-b979-4f16-9b7e-cac84146b962 tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4" status: 404 len: 111 microversion: 2.1 time: 0.028683 May 28 17:45:16.412373 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: [pid: 117604|app: 0|req: 642/1280] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 17:45:16 2022] GET /compute/v2.1/servers/03b782e2-0501-4467-9b07-0a0766795ad4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 17:45:17.689104 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: DEBUG nova.api.openstack.wsgi [None req-aca22fe0-b06e-4d0a-851a-2ef07d25332f tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] Calling method '.version_select at 0x7f9f013a11f0>' {{(pid=117605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 17:45:17.715173 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO nova.api.openstack.requestlog [None req-aca22fe0-b06e-4d0a-851a-2ef07d25332f tempest-TestVolumeBootPattern-1713257441 tempest-TestVolumeBootPattern-1713257441-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1169689163" status: 202 len: 0 microversion: 2.1 time: 0.030020 May 28 17:45:17.716212 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: [pid: 117605|app: 0|req: 639/1281] 10.222.0.33 () {58 vars in 1262 bytes} [Sat May 28 17:45:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1169689163 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 17:45:30.190251 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 17:45:30.190940 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Sat May 28 17:45:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 17:45:50.754813 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 17:45:50.755946 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Sat May 28 17:45:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 17:46:09.526863 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 17:46:09.527486 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Sat May 28 17:46:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 17:47:58.864657 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 17:47:58.865319 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Sat May 28 17:47:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 17:48:50.199263 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 17:48:50.200432 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Sat May 28 17:48:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 17:49:10.764446 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 17:49:10.764995 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Sat May 28 17:49:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 17:49:29.535036 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 17:49:29.535703 dv-cinder-843729-1-iscsi devstack@n-api.service[117604]: Sat May 28 17:49:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 17:50:37.188694 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 17:50:37.189374 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Sat May 28 17:50:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 17:50:52.165591 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 17:50:52.166346 dv-cinder-843729-1-iscsi devstack@n-api.service[117605]: Sat May 28 17:50:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!